-- Logs begin at Mon 2022-07-18 01:36:07 UTC, end at Mon 2022-07-18 02:53:36 UTC. -- Jul 18 02:26:03.850863 dv-cinder-850015-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 02:26:03.858926 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 02:26:03 2022] *** Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: nodename: dv-cinder-850015-3-iscsi Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: machine: x86_64 Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: clock source: unix Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: pcre jit disabled Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: detected number of CPU cores: 4 Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: current working directory: / Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: detected binary path: /usr/bin/uwsgi-core Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: your processes number limit is 47680 Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: your memory page size is 4096 bytes Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: detected max file descriptor number: 2048 Jul 18 02:26:03.861496 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: lock engine: pthread robust mutexes Jul 18 02:26:03.862507 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: thunder lock: enabled Jul 18 02:26:03.862507 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 02:26:03.862507 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 02:26:03.900997 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: Python main interpreter initialized at 0x556277f669c0 Jul 18 02:26:03.900997 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: python threads support enabled Jul 18 02:26:03.900997 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: your server socket listen backlog is limited to 100 connections Jul 18 02:26:03.900997 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: your mercy for graceful operations on workers is 90 seconds Jul 18 02:26:03.901334 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 02:26:03.901412 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: *** Operational MODE: preforking *** Jul 18 02:26:03.901647 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: *** uWSGI is running in multiple interpreter mode *** Jul 18 02:26:03.901647 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: spawned uWSGI master process (pid: 103898) Jul 18 02:26:03.901830 dv-cinder-850015-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 02:26:03.902377 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: spawned uWSGI worker 1 (pid: 103899, cores: 1) Jul 18 02:26:03.902713 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: spawned uWSGI worker 2 (pid: 103900, cores: 1) Jul 18 02:26:03.902882 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 02:26:04.565864 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 02:26:04.570480 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 02:26:05.672393 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:26:05.672393 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: from cryptography.utils import int_from_bytes Jul 18 02:26:05.672900 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:26:05.672900 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: from cryptography.utils import int_from_bytes Jul 18 02:26:05.674662 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:26:05.674662 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: from cryptography.utils import int_from_bytes Jul 18 02:26:05.675107 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:26:05.675107 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: from cryptography.utils import int_from_bytes Jul 18 02:26:08.152065 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 02:26:08.152791 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 02:26:08.152892 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 02:26:08.153171 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 02:26:08.153425 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 02:26:08.153808 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.154167 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.154282 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 02:26:08.154719 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.154806 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 02:26:08.154887 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.155151 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 02:26:08.155252 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.155522 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 02:26:08.155614 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.155784 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 02:26:08.155873 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.156141 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.156229 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.156469 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.156559 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.156731 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.156830 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.157044 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.157133 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.157371 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850015-3-iscsi {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.157461 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.157693 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.157789 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.157999 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.158121 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.158333 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.158429 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.158649 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.158739 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.158952 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.159042 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.159268 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.159367 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.159569 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.159657 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850015-3-iscsi {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.159914 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.160079 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.160227 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.160511 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.160638 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.160811 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.160907 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.161124 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.161226 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.161459 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.161552 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.161769 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.161866 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.162073 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.162318 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.162505 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.162699 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.162830 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.162965 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.163053 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.163230 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.163322 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.163570 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.163696 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850015-3-iscsi {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.163889 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.164079 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.164248 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.164349 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.164520 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.164616 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.164833 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.164999 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.165161 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.165303 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.165474 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.165603 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.165874 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850015-3-iscsi {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.165964 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.166221 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.166316 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.166544 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.166679 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.166863 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.166952 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.167186 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.167288 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.167506 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.167597 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.167826 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.167914 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.168127 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.168225 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.168437 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.168525 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.168746 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.168843 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.169066 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.169169 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.169370 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.169459 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.169675 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.169764 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.170719 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.170834 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.171031 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.171174 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.171356 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.171522 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.171685 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.171839 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.171987 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.172190 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.172283 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.172476 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.172579 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.172790 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.172882 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.173044 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.173133 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.173356 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.173448 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.173682 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.173774 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.173985 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.174127 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.174320 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.174446 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.174593 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.174696 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.174847 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.174955 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.175171 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.175270 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.175496 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.175586 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.175809 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.175912 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.176119 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.176206 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.176427 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.176514 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.176734 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.176831 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.177041 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.177128 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.177352 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.177447 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.177662 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.177763 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.177972 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.178060 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.178319 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.178407 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.178639 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.178735 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.178944 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.179031 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.179259 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.179345 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.179578 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.179666 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.179885 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.179975 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.180190 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.180286 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.180496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.180586 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.180816 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.180906 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.181146 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.181235 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.181450 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.181540 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.181700 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.181788 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.182000 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.182121 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.182328 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.182419 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.182642 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.182730 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.182948 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.183050 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.183258 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.183369 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.183591 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.183690 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.183890 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.183989 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.184195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.184284 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.184510 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.184619 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.184803 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.184902 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.185107 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.185204 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.185428 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.185550 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.186376 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.186577 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.186722 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.187070 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.187163 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.187388 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.187554 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.187702 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.188015 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.188105 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.188329 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.188515 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.188645 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.188851 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.188941 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.189167 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.189257 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.189477 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.189583 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.189789 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.189878 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.190126 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.190235 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.190445 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.190574 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.190754 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.190845 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.191064 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.191154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.191388 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.191489 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.191718 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.191825 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.192026 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.192116 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.192349 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.192450 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.192660 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.192760 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.192968 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.193056 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.193287 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.193383 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.193586 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.193673 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.193892 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.193981 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.194233 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.194338 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.194550 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.194668 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.194853 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.194965 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.195157 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.195256 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.195463 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.195570 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.195765 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.195863 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.196070 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.196167 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.196372 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.196469 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.196677 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.196784 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.196973 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.197076 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.197277 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.197373 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.197587 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.197686 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.197895 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.198000 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.198221 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.198318 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.198524 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.198636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.198840 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.198936 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.199164 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.199260 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.199484 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.199590 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.199796 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.199894 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.200103 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.200200 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.200424 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:26:08.200532 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.200752 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.200849 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.201069 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.201170 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.201451 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.201633 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.201771 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.202010 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.202135 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.202383 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.202489 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.202713 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.202840 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.203023 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.203121 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.203339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.203435 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.203652 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.203739 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.203980 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.204067 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.204312 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.204413 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.204628 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.204783 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.204921 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.205010 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.205230 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.205330 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.205548 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.205637 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.205877 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.205967 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.206231 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.206375 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.206530 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.206620 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.206852 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.206947 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.207168 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.207267 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.207490 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.207585 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.207811 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.207910 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.208130 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.208231 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.208441 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.208537 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.208748 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.208837 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.209055 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.209146 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.209375 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.209464 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.209708 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.209810 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.210019 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.210177 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.210361 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.210450 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.210671 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.210767 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.210981 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.211071 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.211288 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.211384 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.211599 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.211696 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.211908 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.212001 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.212228 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.212318 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.212539 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.212635 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.212852 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.212966 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.213160 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.213255 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.213471 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.213593 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.213783 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.213871 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.214137 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.214233 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.214452 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.214556 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.214756 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.214891 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.215060 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.215150 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.215365 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.215463 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.215674 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.215764 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.215976 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.216066 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.216294 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.216385 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.216621 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.216710 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.217450 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.217548 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.217770 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.217889 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.218093 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.218232 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.218412 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.218545 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.218723 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.218870 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.219033 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.219206 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.219340 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.219515 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.219652 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.219853 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.219947 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.220167 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.220263 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.220484 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.220586 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.220800 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.220891 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.221112 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.221201 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.221421 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.221511 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.221738 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.221827 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.222039 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.222186 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.222377 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.222469 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.222689 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.222787 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.223001 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.223088 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.223308 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.223404 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.223618 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.223716 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.223926 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.224023 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.224236 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.224326 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.224541 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.224631 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.224857 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.225075 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.225166 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.225248 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.225474 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.225564 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.225787 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.225890 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.226124 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.226245 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.226445 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.226538 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.226745 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.226845 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.227055 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.227152 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.227360 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.227450 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.227663 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.227753 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.227969 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.228059 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.228275 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.228364 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.228575 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.228665 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.228877 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.228976 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.229178 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.229268 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.229477 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.229576 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.229777 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.229878 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.230124 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.230229 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.230422 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.230517 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.230725 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.230812 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.231021 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.231117 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.231322 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.231477 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.231623 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.231718 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.231927 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.232026 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.232250 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.232387 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.232611 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.233228 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.233416 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.233555 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.233727 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.233880 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.234031 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.234216 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.234405 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.234536 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.234711 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.234847 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.235057 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.235159 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.235395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.235495 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.235719 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.235808 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.236044 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.236132 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.236352 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.236448 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.236671 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.236831 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.236973 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.237113 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.237281 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.237429 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.237589 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.237744 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.237882 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.238018 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.238224 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.238325 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.238536 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.238632 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.238857 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.238956 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.239170 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.239267 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.239492 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.239581 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.239803 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.239899 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.240107 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.240195 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.240420 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.240509 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.240727 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.240825 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.241035 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.241125 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.241343 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.241439 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.241652 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.241779 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.241970 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.242068 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.242302 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.242412 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.242622 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.242721 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.242929 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.243025 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.243237 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.243324 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.243544 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.243632 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.243853 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.243942 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.244152 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.244246 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.244466 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.244556 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.244783 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.244871 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.245149 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.245247 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.245408 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.245505 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.245714 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.245803 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.246030 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.246176 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.246363 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.246452 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.246669 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.246757 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.246981 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.247088 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.247283 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.247400 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.247585 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.247674 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.247899 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.247997 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.248250 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.248378 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.248564 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.248875 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.248963 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.249187 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.249278 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.249495 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.249583 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.249801 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.249889 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.250127 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.250220 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.250438 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.250526 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.250740 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.250842 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.251051 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.251139 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.251358 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.251454 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.251665 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.251762 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.251975 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.252070 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.252282 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.252370 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.252583 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.252679 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.252887 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.253042 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.253209 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.253308 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.253519 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.253623 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.253823 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.253972 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.254154 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.254246 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.254460 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.254559 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.254765 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.254853 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.255090 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.255179 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.255392 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.255490 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.255698 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.255786 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.256005 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.256101 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.256310 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.256400 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.256623 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.256711 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.256931 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.257021 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.257236 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.257334 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.257552 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.257640 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.257868 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.257968 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.258198 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.258298 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.258507 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.258609 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.258818 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.258915 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.259126 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.259218 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.259434 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.259523 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.259744 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.259841 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.260052 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.260174 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.260359 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.260449 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.260664 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.260764 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.260966 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.261056 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.261272 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.261362 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.261586 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.261677 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.261895 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.262183 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.262275 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.262525 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.262627 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.262833 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.262932 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.263143 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.263240 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.263463 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.263564 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.263858 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.264053 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.264364 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.264466 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.264693 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.264793 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.265014 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.265104 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.265324 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.265422 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.265636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.265728 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.265942 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.266033 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.266271 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.266363 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.266584 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.266687 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.266891 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.266992 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.267199 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.267289 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.267504 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.267595 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.267814 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.267911 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.268116 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.268212 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.268419 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.268508 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.268722 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.268817 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.269024 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.269113 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.269331 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.269419 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.269630 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.269728 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.269935 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.270024 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.270258 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.270347 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.270565 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.270663 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.270876 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.270964 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.271181 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.271274 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.271479 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.271568 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.271778 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.271868 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.272100 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.272188 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.272406 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.272496 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.272711 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.272800 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.273019 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.273118 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.273326 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.273415 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.273669 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.273756 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.273971 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.274073 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.274320 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.274421 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.274620 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.274723 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.274923 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.275023 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.275223 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.275320 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.275531 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.275629 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.275834 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.275926 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.276133 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.276224 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.276441 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.276530 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.276746 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.276837 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.277052 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.277190 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.277358 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.277446 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.277658 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.277747 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.277967 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.278056 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.278292 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.278383 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.278604 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.278706 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.278908 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.278997 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.279208 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.279845 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.280110 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.280215 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.280481 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.280573 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.280794 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.280898 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.281099 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.281200 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.281407 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.281495 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.281709 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.281806 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.282020 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.282153 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.282350 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.282438 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.282653 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.282761 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.282957 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.283050 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.283261 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.283349 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.283566 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.283656 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.283867 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.283955 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.284170 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.284257 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.284477 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.284567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.284783 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.284871 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.285088 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.285186 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.285391 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.285479 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.285694 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.285792 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.285996 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.286134 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.286329 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.286421 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.286636 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.286724 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.286949 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.287052 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.287248 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.287336 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.287553 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.287642 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.287852 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.287949 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.288154 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.288251 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.288461 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.288550 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.288766 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.288865 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.289066 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.289155 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.289364 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.289461 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.289666 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.289792 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.289966 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.290056 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.290290 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.290393 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.290598 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.290687 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.290903 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.291000 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.291206 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.291293 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.291507 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.291603 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.291808 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.291896 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.292129 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.292217 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.292437 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.292534 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.292741 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.292829 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.293051 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.293152 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.293356 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.293454 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.293688 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.293777 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.294012 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.294139 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.294324 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.294413 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.294635 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.294723 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.295791 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.295910 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.296105 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.296345 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.296434 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.296523 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.296717 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.296817 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.297020 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.297109 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.297322 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.297427 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.297643 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.297743 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.297956 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.298046 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.298296 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.298387 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.298616 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.298718 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.298938 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.299030 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.299255 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.299343 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.299557 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.299647 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.299865 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.299955 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.300175 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.300263 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.300482 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.300572 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.300788 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.300879 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.301094 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.301190 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.301405 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.301494 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.301712 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.301800 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.302019 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.302141 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.302354 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.302483 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.302664 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.302797 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.302967 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.303108 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.303276 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.303413 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.303583 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.303728 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.303886 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.304043 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.304210 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.304355 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.304518 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.304663 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.304819 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.304974 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.305127 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.305285 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.305430 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.305591 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.305736 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.305922 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.306043 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.306260 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.306482 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.306574 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.306794 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.306887 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.307103 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.307192 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.307410 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.307572 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.307720 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.307861 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.307999 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.308168 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.308302 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.308485 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.308708 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.308857 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.308997 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.309134 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.309288 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.309435 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.309602 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.309741 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.309910 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.310058 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.310249 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.310353 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.310586 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.310779 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.310946 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.311145 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.311244 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.311370 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.311472 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.311644 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.311764 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.311960 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.312109 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.312270 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.312361 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.312576 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.312665 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.312890 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.312989 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.313218 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.313307 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.313524 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.313642 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.313830 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.313955 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.314160 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.314282 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.314487 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.314698 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.314799 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.315010 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.315103 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.315319 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.315509 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.315639 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.315822 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.315957 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.316130 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.316277 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.316550 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.316648 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.316869 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.316971 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.317173 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.317269 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.317494 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.317603 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.317814 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.317905 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.318144 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.318249 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.318462 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.318561 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.318764 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.318863 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.319075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.319167 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.319392 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.319489 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.319703 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.319801 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.320016 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.320106 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.320339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.320435 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.320644 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.320734 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.320970 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.321061 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.321294 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.321383 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.321611 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.321701 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.321921 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.322010 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.322245 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.322371 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.322558 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.322699 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.322864 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.323017 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.323167 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.323341 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.323491 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.323671 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.323794 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.323978 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.324104 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.324287 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.324414 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.324600 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.324722 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.324907 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.325026 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.325215 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.325312 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.325545 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.325644 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.325854 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.325944 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.326225 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.326480 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.326577 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.326660 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.326843 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.326935 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.327149 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.327253 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.327455 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.327576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.327782 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.327881 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.328089 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.328197 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.328395 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.328495 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.328699 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.328789 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.329001 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.329105 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.329338 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.329427 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.329637 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.329733 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.329955 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.330047 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.330296 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.330397 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.330605 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.330694 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.330912 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.331002 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.331217 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.331307 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.331548 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.331643 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.331851 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.331941 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.332162 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.332250 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.332486 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.332576 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.332788 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.332879 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.333089 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.333179 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.333396 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.333494 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.333697 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.333788 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.334014 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.334128 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.334322 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.334423 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.334627 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.334766 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.334926 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.335017 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.335225 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.335324 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.335523 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.335621 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.335840 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.335930 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.336138 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.336282 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.336458 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.336550 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.336764 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.336861 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.337067 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.337157 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.337368 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.337456 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.337668 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.337799 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.337993 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.338133 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.338319 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.338408 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.338642 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.338754 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.338955 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.339047 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.339263 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.339364 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.339570 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.339660 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.339878 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.339973 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.340196 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.340285 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.340512 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.340615 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.340827 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.340916 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.341139 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.341229 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.341451 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.341554 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.341761 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.342419 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.342684 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.342781 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.343023 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.343124 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.343349 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.343440 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.343672 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.343771 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.343982 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.344084 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.344298 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.344389 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.344615 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.344815 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.344976 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.345142 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.345233 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.345458 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.345548 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.345774 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.345877 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.346095 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.346188 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.346413 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.346513 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.346725 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.346991 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.347090 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.347326 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.347416 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.347634 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.347731 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.347944 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.348043 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.348255 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.348343 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.348573 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.348735 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.348890 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.348990 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.349205 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.349303 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.349519 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.349617 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.349831 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.349924 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.350168 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.350263 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.350482 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.350573 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.350820 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.350909 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.351136 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.351249 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.351438 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.351530 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.351748 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.351840 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.352060 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.352163 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.352370 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.352460 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.352680 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.352770 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.352988 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.353091 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.353301 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.353394 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.353610 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.353699 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.353918 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.354018 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.354249 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.354349 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.354560 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.354651 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.354871 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.354963 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.355182 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.355272 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.355500 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.355598 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.355812 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.355902 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.356122 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.356220 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.356432 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.356531 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.356741 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.356831 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.357054 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.357259 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.357380 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.358291 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.358389 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.358621 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.358719 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.358940 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.359031 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.359256 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.359355 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.359574 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.359669 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.359891 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.360095 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.360217 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.360412 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.360523 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.360755 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.360844 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.361084 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.361183 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.361412 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.361502 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.361709 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.361804 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.362030 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.362180 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.362368 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.362459 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.362671 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.362800 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.362977 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.363068 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.363283 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.363372 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.363593 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.363817 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.363920 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.364167 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.364277 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.364475 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.364570 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.364797 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.364896 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.365118 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.365215 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.365427 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.365515 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.365731 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.365963 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.366052 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.366340 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.366443 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.366659 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.366758 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.366970 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.367060 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.367278 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.367369 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.367580 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.367709 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.367881 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.367971 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.368188 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.368315 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.368493 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.368591 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.368797 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.368888 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.369102 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.369191 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.369404 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.369495 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.369709 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.369805 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.370017 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.370127 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.370343 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.370434 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.370645 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.370742 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.370953 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.371041 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.371250 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.371339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.371549 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.371640 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.371851 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.371954 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.372151 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.372241 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.372459 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.372549 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.372760 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.372863 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.373095 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.373195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.373404 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.373492 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.373709 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.373845 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.374038 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.374150 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.374362 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.374451 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.374677 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.374780 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.374986 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.375075 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.375298 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.375397 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.375600 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.375699 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.375914 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.376005 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.376222 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.376317 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.376536 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.376679 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.376846 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.376935 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.377158 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.377254 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.377501 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.377590 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.377806 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.377896 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.378151 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.378373 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.378544 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.378718 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.378807 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.379043 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.379133 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.379381 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.379485 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.379716 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.379806 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.380025 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.380141 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.380333 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.380571 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.380668 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.380916 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.381005 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.381245 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.381345 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.381554 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.381643 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.381864 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.381962 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.382194 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.382301 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.382508 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.382605 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.382819 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.382908 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.383129 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.383221 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.383438 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.383528 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.383747 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.383837 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.384056 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.384156 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.384363 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.384453 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.384671 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.384761 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.384980 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.385075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.385291 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.385380 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.385604 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.385707 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.385920 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.386011 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.386262 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.386353 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.386575 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.386677 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.386887 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.386985 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.387193 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.387282 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.387503 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.387602 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.387811 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.387902 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.388118 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.388207 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.388433 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.388580 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.388800 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.388901 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.389125 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.389216 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.389444 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.389608 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.389760 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.390033 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.390161 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.390374 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.390473 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.390696 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.390785 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.391016 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.391107 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.391330 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.391430 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.391641 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.391733 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.391965 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.392054 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.392278 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.392369 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.392601 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.392691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.392912 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.393009 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.393240 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.393331 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.393579 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.393669 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.394296 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.394399 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.394399 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.394577 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.394577 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.394727 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.394841 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.394945 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.395144 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.395234 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.395454 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.395546 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.395774 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.395874 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.396084 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.396236 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.396407 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.396501 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.396689 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.396788 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.396998 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.397088 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.397301 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.397390 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.397603 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.397701 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.397905 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.397995 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.398235 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.398330 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.398546 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.398638 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.398848 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.398937 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.399151 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.399249 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.399453 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.399545 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.399758 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.399845 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.400060 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.400148 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.400362 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.400453 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.400671 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.400759 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.400971 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.401072 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.401273 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.401364 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.401571 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.401697 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.401872 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.401972 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.402271 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.402370 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.402518 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.402608 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.402828 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.402952 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.403136 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.403227 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.403443 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.403533 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.403749 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.403848 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.404054 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.404189 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.404930 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.405024 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.405339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.405536 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.405662 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.405790 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.405993 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.406134 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.406340 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.406439 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.406668 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.406757 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.406986 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.407076 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.407316 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.407415 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.407640 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.407729 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.407952 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.408046 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.408261 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.408355 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.408570 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.408667 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.408896 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.409004 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.409214 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.409348 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.409521 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.409610 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.409834 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.409934 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.410174 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.410269 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.410491 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.410583 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.410803 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.410900 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.411114 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.411204 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.411442 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.411533 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.411752 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.411843 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.412060 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.412219 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.412365 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.412455 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.412676 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.412768 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.412984 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.413073 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.413299 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.413388 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.413610 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.413703 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.413920 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.414010 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.414261 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.414373 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.414574 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.414670 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.414885 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.414974 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.415206 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.415309 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.415511 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.415600 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.415823 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.415911 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.416143 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.416243 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.416463 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.416553 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.416785 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.416882 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.417113 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.417203 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.417427 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.417517 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.417739 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.417829 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.418051 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.418173 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.418377 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.418467 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.418620 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 02:26:08.418752 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.419100 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.419433 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.419751 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.420875 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.421229 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:26:08.421510 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 02:26:08.479596 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO dbcounter [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Registered counter for database nova_api Jul 18 02:26:08.484506 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO dbcounter [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Registered counter for database nova_api Jul 18 02:26:08.594859 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_db.sqlalchemy.engines [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:26:08.596071 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG oslo_db.sqlalchemy.engines [None req-3390a591-061c-4ea3-8939-df9453405824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:26:08.601424 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writer thread running {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:26:08.602605 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG dbcounter [-] [103900] Writer thread running {{(pid=103900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:26:08.658296 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.context [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96635aa1-f097-4770-8a14-36db95b56343(cell1) {{(pid=103899) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 02:26:08.658471 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.context [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96635aa1-f097-4770-8a14-36db95b56343(cell1) {{(pid=103900) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 02:26:08.662218 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.662578 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG oslo_concurrency.lockutils [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.663801 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:08.664234 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG oslo_concurrency.lockutils [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:08.664609 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.665036 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG oslo_concurrency.lockutils [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:26:08.666765 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:08.667232 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG oslo_concurrency.lockutils [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:26:08.668752 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO dbcounter [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Registered counter for database nova_cell0 Jul 18 02:26:08.669224 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO dbcounter [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Registered counter for database nova_cell0 Jul 18 02:26:08.672907 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO dbcounter [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Registered counter for database nova_cell1 Jul 18 02:26:08.673356 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO dbcounter [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Registered counter for database nova_cell1 Jul 18 02:26:08.680409 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_db.sqlalchemy.engines [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:26:08.682207 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_db.sqlalchemy.engines [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:26:08.684143 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG oslo_db.sqlalchemy.engines [None req-3390a591-061c-4ea3-8939-df9453405824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:26:08.686595 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG oslo_db.sqlalchemy.engines [None req-3390a591-061c-4ea3-8939-df9453405824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:26:08.688257 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writer thread running {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:26:08.690873 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writer thread running {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:26:08.691595 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG dbcounter [-] [103900] Writer thread running {{(pid=103900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:26:08.694248 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG dbcounter [-] [103900] Writer thread running {{(pid=103900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:26:08.837353 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO dbcounter [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Registered counter for database nova_cell0 Jul 18 02:26:08.838315 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO dbcounter [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Registered counter for database nova_cell0 Jul 18 02:26:08.846779 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_db.sqlalchemy.engines [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:26:08.849772 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG oslo_db.sqlalchemy.engines [None req-3390a591-061c-4ea3-8939-df9453405824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:26:08.851397 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writer thread running {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:26:08.854154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG dbcounter [-] [103900] Writer thread running {{(pid=103900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:26:09.280188 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: WARNING keystonemiddleware.auth_token [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:26:09.287451 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: WARNING keystonemiddleware.auth_token [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:26:09.309976 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: WARNING keystonemiddleware.auth_token [None req-3390a591-061c-4ea3-8939-df9453405824 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:26:09.317749 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: WARNING keystonemiddleware.auth_token [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:26:09.631450 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: WARNING keystonemiddleware.auth_token [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:26:09.637398 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: WARNING keystonemiddleware.auth_token [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:26:09.642843 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556277f669c0 pid: 103899 (default app) Jul 18 02:26:09.644889 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:26:09.646077 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001707 Jul 18 02:26:09.646516 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Mon Jul 18 02:26:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:26:09.662525 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: WARNING keystonemiddleware.auth_token [None req-3390a591-061c-4ea3-8939-df9453405824 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:26:09.668506 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: WARNING keystonemiddleware.auth_token [None req-3390a591-061c-4ea3-8939-df9453405824 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:26:09.674726 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556277f669c0 pid: 103900 (default app) Jul 18 02:27:29.003959 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:29.005035 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 18 02:27:29.005432 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:29.018463 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG dbcounter [-] [103900] Writing DB stats nova_api:SELECT=3 {{(pid=103900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:29.019786 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG dbcounter [-] [103900] Writing DB stats nova_cell0:SELECT=3 {{(pid=103900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:29.020897 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG dbcounter [-] [103900] Writing DB stats nova_cell1:SELECT=3 {{(pid=103900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:29.021750 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG dbcounter [-] [103900] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:29.875642 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-5ac29925-0342-42f9-a773-f54c22f441e4 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:29.904876 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-5ac29925-0342-42f9-a773-f54c22f441e4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.892348 Jul 18 02:27:29.905444 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 18 02:27:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:32.131185 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:32.132204 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-328284f7-bccf-401b-a097-9c31ef366ee4 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 18 02:27:32.133274 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:32.628812 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-75db21a6-f8c7-432f-a805-405fa67ac9b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "id": "c1", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:32.648328 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:27:32.648328 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: warnings.warn(msg) Jul 18 02:27:32.736749 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-75db21a6-f8c7-432f-a805-405fa67ac9b7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.595859 Jul 18 02:27:32.744342 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 18 02:27:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:27:32.752007 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writing DB stats nova_api:SELECT=3 {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:32.753142 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writing DB stats nova_cell1:SELECT=3 {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:32.754564 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writing DB stats nova_cell0:SELECT=3 {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:32.755326 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:32.962970 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-2aaa6183-3557-4b58-b91b-bfa4ee9570e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:32.965423 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:27:32.965423 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: warnings.warn(msg) Jul 18 02:27:33.098685 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-2aaa6183-3557-4b58-b91b-bfa4ee9570e1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.352945 Jul 18 02:27:33.099714 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 18 02:27:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:35.349880 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-75db21a6-f8c7-432f-a805-405fa67ac9b7 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:35.351014 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-75db21a6-f8c7-432f-a805-405fa67ac9b7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jul 18 02:27:35.352415 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:36.025404 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-e96ad63e-83b2-4a98-a661-5568338b2677 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "disk": 5, "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:36.044738 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:27:36.044738 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: warnings.warn(msg) Jul 18 02:27:36.152012 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-e96ad63e-83b2-4a98-a661-5568338b2677 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.793956 Jul 18 02:27:36.152575 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 18 02:27:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:27:36.165016 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-8f1db5cd-926d-44c0-bcae-9c581d5bd4d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:36.166925 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:27:36.166925 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: warnings.warn(msg) Jul 18 02:27:36.240037 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-8f1db5cd-926d-44c0-bcae-9c581d5bd4d9 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079056 Jul 18 02:27:36.240733 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 18 02:27:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (3 switches on core 0) Jul 18 02:27:38.486504 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-e96ad63e-83b2-4a98-a661-5568338b2677 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:38.487705 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-e96ad63e-83b2-4a98-a661-5568338b2677 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Jul 18 02:27:38.488213 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:38.896515 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-e7982388-dbdd-42da-ac1b-eefdcc38ea13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "id": "d2"}} {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:38.950972 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-e7982388-dbdd-42da-ac1b-eefdcc38ea13 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456145 Jul 18 02:27:38.951519 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 18 02:27:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:27:38.963535 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-9ec77205-ebaf-4201-8503-9447cfabc5b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:39.028347 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-9ec77205-ebaf-4201-8503-9447cfabc5b5 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068651 Jul 18 02:27:39.028845 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 18 02:27:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:41.221429 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-e7982388-dbdd-42da-ac1b-eefdcc38ea13 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:41.223018 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-e7982388-dbdd-42da-ac1b-eefdcc38ea13 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Jul 18 02:27:41.223814 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:41.695565 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-d6a757e1-3e80-4bdc-ae63-4ec293ad5579 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:41.783365 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-d6a757e1-3e80-4bdc-ae63-4ec293ad5579 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.552715 Jul 18 02:27:41.783883 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 18 02:27:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:27:41.798326 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-48b9599d-8727-486d-9967-cfed1edf0635 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:41.885719 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-48b9599d-8727-486d-9967-cfed1edf0635 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092030 Jul 18 02:27:41.898663 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 18 02:27:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:44.115161 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-d6a757e1-3e80-4bdc-ae63-4ec293ad5579 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:44.116687 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-d6a757e1-3e80-4bdc-ae63-4ec293ad5579 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 18 02:27:44.116687 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:44.529300 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-21c04e2c-4ef7-4f37-8692-88dd2cc3af3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:44.590309 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-21c04e2c-4ef7-4f37-8692-88dd2cc3af3d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468382 Jul 18 02:27:44.591072 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 18 02:27:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:27:44.606783 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-3ee3e892-7606-49e2-b496-4e5f16dc14ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:44.686758 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-3ee3e892-7606-49e2-b496-4e5f16dc14ad admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083599 Jul 18 02:27:44.695982 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 18 02:27:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:47.169702 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-21c04e2c-4ef7-4f37-8692-88dd2cc3af3d admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:47.170768 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-21c04e2c-4ef7-4f37-8692-88dd2cc3af3d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 18 02:27:47.171347 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:47.612399 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-a19ada3f-71e2-480f-8922-85a7c2a46f47 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:47.640400 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-a19ada3f-71e2-480f-8922-85a7c2a46f47 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.463169 Jul 18 02:27:47.641409 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 18 02:27:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:27:49.960715 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-21c04e2c-4ef7-4f37-8692-88dd2cc3af3d admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:49.961760 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-21c04e2c-4ef7-4f37-8692-88dd2cc3af3d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 18 02:27:49.962187 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:50.425118 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-02f9de83-4be5-4223-b15d-1ce379623df7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1"}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:50.493664 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-02f9de83-4be5-4223-b15d-1ce379623df7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.525482 Jul 18 02:27:50.494255 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 18 02:27:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:27:50.508248 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-a367bccd-24a7-4b13-be82-9b0b5cf3ede3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:50.576440 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-a367bccd-24a7-4b13-be82-9b0b5cf3ede3 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073177 Jul 18 02:27:50.576958 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 18 02:27:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:52.882938 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-02f9de83-4be5-4223-b15d-1ce379623df7 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:52.883876 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-02f9de83-4be5-4223-b15d-1ce379623df7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 18 02:27:52.884281 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:53.279081 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-94d3fb4a-0ffb-4422-9160-1d42f49b3ab3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "id": "2", "name": "m1.small", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:53.349290 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-94d3fb4a-0ffb-4422-9160-1d42f49b3ab3 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459061 Jul 18 02:27:53.349974 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 18 02:27:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:27:53.361904 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-86e7a7f9-0d6f-4419-a993-91ec009ad92c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:53.433534 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-86e7a7f9-0d6f-4419-a993-91ec009ad92c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075272 Jul 18 02:27:53.434043 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 18 02:27:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:27:55.658970 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-94d3fb4a-0ffb-4422-9160-1d42f49b3ab3 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:55.659994 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-94d3fb4a-0ffb-4422-9160-1d42f49b3ab3 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Jul 18 02:27:55.660432 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:56.041418 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-edb5b220-0dea-442f-9038-ede41d26039a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "swap": 0}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:56.269356 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-edb5b220-0dea-442f-9038-ede41d26039a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.601401 Jul 18 02:27:56.269842 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 18 02:27:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:27:56.282256 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-2b62d37d-2b14-4dcd-8ecc-40f03ec43835 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:56.399227 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-2b62d37d-2b14-4dcd-8ecc-40f03ec43835 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120601 Jul 18 02:27:56.399841 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 18 02:27:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:27:58.633425 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-edb5b220-0dea-442f-9038-ede41d26039a admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:27:58.634475 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-edb5b220-0dea-442f-9038-ede41d26039a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 18 02:27:58.635030 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:27:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:27:59.150502 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-0c4d7163-7f7b-4469-a2f2-b8b51c7b548c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "vcpus": 4, "id": "4"}} {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:59.155825 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG dbcounter [-] [103900] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:59.229884 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-0c4d7163-7f7b-4469-a2f2-b8b51c7b548c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.588840 Jul 18 02:27:59.238891 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 18 02:27:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:27:59.244161 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-8dc5c951-c4ee-41e1-b168-64b9a332a282 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:27:59.312956 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-8dc5c951-c4ee-41e1-b168-64b9a332a282 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072639 Jul 18 02:27:59.313552 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 18 02:27:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:01.577872 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-0c4d7163-7f7b-4469-a2f2-b8b51c7b548c admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:01.580966 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-0c4d7163-7f7b-4469-a2f2-b8b51c7b548c admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 18 02:28:01.580966 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:28:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:02.003453 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-c9d4c065-ba54-41a8-83e6-43ea6ae3f1ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:02.075358 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-c9d4c065-ba54-41a8-83e6-43ea6ae3f1ad admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.489482 Jul 18 02:28:02.076045 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 18 02:28:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:28:02.088410 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-93eb6e46-c466-4bda-a394-47d6cb0f7f78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:02.183995 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-93eb6e46-c466-4bda-a394-47d6cb0f7f78 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099195 Jul 18 02:28:02.184796 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 18 02:28:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:28:22.807127 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-c9d4c065-ba54-41a8-83e6-43ea6ae3f1ad admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:22.808127 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-c9d4c065-ba54-41a8-83e6-43ea6ae3f1ad admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 18 02:28:22.808521 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:28:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:23.190725 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-7912e149-f8a8-41fb-83ee-93f3d8db2e3a admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:23.207935 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-7912e149-f8a8-41fb-83ee-93f3d8db2e3a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.393711 Jul 18 02:28:23.208468 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 18 02:28:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:24.261266 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-c9d4c065-ba54-41a8-83e6-43ea6ae3f1ad admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:24.262313 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-c9d4c065-ba54-41a8-83e6-43ea6ae3f1ad admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 18 02:28:24.262739 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:24.781452 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-a6ca80f9-ae10-424d-a7dc-95d8234147bb admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:24.787823 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.wsgi [None req-a6ca80f9-ae10-424d-a7dc-95d8234147bb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-a6ca80f9-ae10-424d-a7dc-95d8234147bb admin admin] Request method failure captured: Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Accept: application/json Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Accept-Encoding: gzip, deflate Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Connection: keep-alive Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Content-Length: 0 Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Host: 10.222.0.66 Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Openstack-Api-Version: compute 2.90 Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Openstack-System-Scope: None Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: User-Agent: python-novaclient Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Auth-Token: gAAAAABi1MVIm5dwpYYVpkYQCgQFRWPQqdIlG6RHHsvh0X5b-8cTB5Tfc4nSHROiVA6OE1o6Zb9weEFezMwgiJXdgNKYwpaTaAI0HR19hV-Ri-afcEf9x_XjAGFT_2S1HHiU9YZmznc_tLFP0tQzxmWbCWqmKQ8ve2PamPhdidZalxtzNdV2uFA Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Domain-Id: None Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Domain-Name: None Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Identity-Status: Confirmed Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Is-Admin-Project: True Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Domain-Id: default Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Domain-Name: Default Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Name: admin Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Role: admin,member,reader Jul 18 02:28:24.791297 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Roles: admin,member,reader Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a05e40a15656441b94f5763e4d68d305", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Tenant: admin Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Tenant-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Tenant-Name: admin Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User: admin Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Domain-Id: default Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Domain-Name: Default Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Id: 62dd67591e0147fe97b248079359a4de Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Name: admin Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: method: > Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: exception: Flavor 42 could not be found. Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: action_args: {'id': '42'} Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:24.793157 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:24.794075 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:24.795339 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-a6ca80f9-ae10-424d-a7dc-95d8234147bb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:24.796556 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-a6ca80f9-ae10-424d-a7dc-95d8234147bb admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391877 Jul 18 02:28:24.796556 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 18 02:28:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:24.802317 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-460ce043-abcb-45ea-bb17-411ecc463db4 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:24.805235 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:24.823586 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-460ce043-abcb-45ea-bb17-411ecc463db4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024851 Jul 18 02:28:24.824116 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 18 02:28:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:24.834329 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-f3d2f403-8c48-46b6-8a53-c089b181f3f9 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:24.856304 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-f3d2f403-8c48-46b6-8a53-c089b181f3f9 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026064 Jul 18 02:28:24.856852 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 18 02:28:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:24.866277 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-947295df-a85d-4a04-9fba-bb61858c5510 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:24.872364 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.wsgi [None req-947295df-a85d-4a04-9fba-bb61858c5510 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-947295df-a85d-4a04-9fba-bb61858c5510 admin admin] Request method failure captured: Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Accept: application/json Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Accept-Encoding: gzip, deflate Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Connection: keep-alive Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Content-Length: 0 Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Host: 10.222.0.66 Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Openstack-Api-Version: compute 2.90 Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Openstack-System-Scope: None Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: User-Agent: python-novaclient Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Auth-Token: gAAAAABi1MVIm5dwpYYVpkYQCgQFRWPQqdIlG6RHHsvh0X5b-8cTB5Tfc4nSHROiVA6OE1o6Zb9weEFezMwgiJXdgNKYwpaTaAI0HR19hV-Ri-afcEf9x_XjAGFT_2S1HHiU9YZmznc_tLFP0tQzxmWbCWqmKQ8ve2PamPhdidZalxtzNdV2uFA Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Domain-Id: None Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Domain-Name: None Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Identity-Status: Confirmed Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Is-Admin-Project: True Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Domain-Id: default Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Domain-Name: Default Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Name: admin Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Role: admin,member,reader Jul 18 02:28:24.875636 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Roles: admin,member,reader Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a05e40a15656441b94f5763e4d68d305", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Tenant: admin Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Tenant-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Tenant-Name: admin Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User: admin Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Domain-Id: default Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Domain-Name: Default Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Id: 62dd67591e0147fe97b248079359a4de Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Name: admin Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: method: > Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: exception: Flavor 42 could not be found. Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: action_args: {'id': '42'} Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:24.882562 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:24.883576 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:24.884893 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-947295df-a85d-4a04-9fba-bb61858c5510 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:24.886187 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-947295df-a85d-4a04-9fba-bb61858c5510 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014260 Jul 18 02:28:24.886187 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 18 02:28:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:25.844854 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-f3d2f403-8c48-46b6-8a53-c089b181f3f9 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:25.845921 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-f3d2f403-8c48-46b6-8a53-c089b181f3f9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 18 02:28:25.846351 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:26.361126 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-14c444df-7176-4df7-98fa-81444ec2e727 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:26.367010 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.wsgi [None req-14c444df-7176-4df7-98fa-81444ec2e727 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-14c444df-7176-4df7-98fa-81444ec2e727 admin admin] Request method failure captured: Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Accept: application/json Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Accept-Encoding: gzip, deflate Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Connection: keep-alive Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Content-Length: 0 Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Host: 10.222.0.66 Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Openstack-Api-Version: compute 2.90 Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Openstack-System-Scope: None Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: User-Agent: python-novaclient Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Auth-Token: gAAAAABi1MVJT0VWT1YILD_MC3VVIGSQCfVuuPRbKUmF8_UNEIxq2qFmuwdMpPcO0ukyGZzNuKIurIH_Wz8NwZ83fglybqSNvofzeOfy7M8znBaNy4oqK3B7J1OziWbd6Df4MWfkiAIY1FSbimiEJZUQO__lcjsrPa3jc9LRF-S1u8dlE7uJt30 Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Domain-Id: None Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Domain-Name: None Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Identity-Status: Confirmed Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Is-Admin-Project: True Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Domain-Id: default Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Domain-Name: Default Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Name: admin Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Role: admin,member,reader Jul 18 02:28:26.368496 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Roles: admin,member,reader Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a05e40a15656441b94f5763e4d68d305", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Tenant: admin Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Tenant-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Tenant-Name: admin Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User: admin Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Domain-Id: default Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Domain-Name: Default Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Id: 62dd67591e0147fe97b248079359a4de Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Name: admin Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: method: > Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: exception: Flavor 84 could not be found. Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: action_args: {'id': '84'} Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:26.370112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:26.371096 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:26.372567 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-14c444df-7176-4df7-98fa-81444ec2e727 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:26.374021 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-14c444df-7176-4df7-98fa-81444ec2e727 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.385393 Jul 18 02:28:26.374021 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 18 02:28:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:26.379948 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-1e146fe3-2aa0-4d77-b2ad-1daed03c8dfd admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:26.393500 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-1e146fe3-2aa0-4d77-b2ad-1daed03c8dfd admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017605 Jul 18 02:28:26.394047 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 18 02:28:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:26.403284 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-5c934982-b91b-4fff-aa67-d2ef2b4e55d1 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:26.417236 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-5c934982-b91b-4fff-aa67-d2ef2b4e55d1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017454 Jul 18 02:28:26.417758 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 18 02:28:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:26.427353 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-2ceb08ce-6ab7-4655-9d61-8896a06788fb admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:26.432642 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.wsgi [None req-2ceb08ce-6ab7-4655-9d61-8896a06788fb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-2ceb08ce-6ab7-4655-9d61-8896a06788fb admin admin] Request method failure captured: Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Accept: application/json Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Accept-Encoding: gzip, deflate Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Connection: keep-alive Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Content-Length: 0 Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Host: 10.222.0.66 Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Openstack-Api-Version: compute 2.90 Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Openstack-System-Scope: None Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: User-Agent: python-novaclient Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Auth-Token: gAAAAABi1MVJT0VWT1YILD_MC3VVIGSQCfVuuPRbKUmF8_UNEIxq2qFmuwdMpPcO0ukyGZzNuKIurIH_Wz8NwZ83fglybqSNvofzeOfy7M8znBaNy4oqK3B7J1OziWbd6Df4MWfkiAIY1FSbimiEJZUQO__lcjsrPa3jc9LRF-S1u8dlE7uJt30 Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Domain-Id: None Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Domain-Name: None Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Identity-Status: Confirmed Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Is-Admin-Project: True Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Domain-Id: default Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Domain-Name: Default Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Name: admin Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Role: admin,member,reader Jul 18 02:28:26.434154 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Roles: admin,member,reader Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a05e40a15656441b94f5763e4d68d305", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Tenant: admin Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Tenant-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Tenant-Name: admin Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User: admin Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Domain-Id: default Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Domain-Name: Default Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Id: 62dd67591e0147fe97b248079359a4de Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Name: admin Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: method: > Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: exception: Flavor 84 could not be found. Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: action_args: {'id': '84'} Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:26.435596 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:26.436395 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:26.437493 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-2ceb08ce-6ab7-4655-9d61-8896a06788fb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:26.438737 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-2ceb08ce-6ab7-4655-9d61-8896a06788fb admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012258 Jul 18 02:28:26.438737 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 18 02:28:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:27.401524 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-5c934982-b91b-4fff-aa67-d2ef2b4e55d1 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:27.402557 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-5c934982-b91b-4fff-aa67-d2ef2b4e55d1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 18 02:28:27.402986 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:27.922946 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-118a59c7-4968-4603-86d2-347e1a146f7e admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:27.929151 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.wsgi [None req-118a59c7-4968-4603-86d2-347e1a146f7e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-118a59c7-4968-4603-86d2-347e1a146f7e admin admin] Request method failure captured: Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Accept: application/json Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Accept-Encoding: gzip, deflate Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Connection: keep-alive Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Content-Length: 0 Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Host: 10.222.0.66 Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Openstack-Api-Version: compute 2.90 Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Openstack-System-Scope: None Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: User-Agent: python-novaclient Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Auth-Token: gAAAAABi1MVL9QOudEs7C2f_G3BU3lNbHMETzmL5WKlgYVHlof-nkDaHZRiSPFpkvEsl9XaT7pxqG77-yzm36QBBEeCOA0qlcvj9wDKOTS_8C76vKww6LRGfjOAHatsCuCf_svNYTvb3J2ji0mQjihM_5mcYJYRg71p2Zuskvh8iXSwksB8QLSM Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Domain-Id: None Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Domain-Name: None Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Identity-Status: Confirmed Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Is-Admin-Project: True Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Domain-Id: default Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Domain-Name: Default Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Project-Name: admin Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Role: admin,member,reader Jul 18 02:28:27.930691 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Roles: admin,member,reader Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a05e40a15656441b94f5763e4d68d305", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Tenant: admin Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Tenant-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-Tenant-Name: admin Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User: admin Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Domain-Id: default Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Domain-Name: Default Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Id: 62dd67591e0147fe97b248079359a4de Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: X-User-Name: admin Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: method: > Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: exception: Flavor 451 could not be found. Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: action_args: {'id': '451'} Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:27.932283 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:27.934859 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: ERROR nova.api.openstack.wsgi Jul 18 02:28:27.935911 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-118a59c7-4968-4603-86d2-347e1a146f7e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:27.937321 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-118a59c7-4968-4603-86d2-347e1a146f7e admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391918 Jul 18 02:28:27.937321 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 18 02:28:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:27.942397 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-92bcb211-21b0-4db7-a122-b58ff70dadda admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:27.956078 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-92bcb211-21b0-4db7-a122-b58ff70dadda admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017879 Jul 18 02:28:27.956613 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 18 02:28:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:27.966391 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:27.983008 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020166 Jul 18 02:28:27.983555 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 18 02:28:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:28:27.993472 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-c2f9e0d9-4f45-4ad2-a069-50f14e0cf6fc admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:27.999112 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.wsgi [None req-c2f9e0d9-4f45-4ad2-a069-50f14e0cf6fc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-c2f9e0d9-4f45-4ad2-a069-50f14e0cf6fc admin admin] Request method failure captured: Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Accept: application/json Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Accept-Encoding: gzip, deflate Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Connection: keep-alive Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Content-Length: 0 Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Host: 10.222.0.66 Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Openstack-Api-Version: compute 2.90 Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Openstack-System-Scope: None Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: User-Agent: python-novaclient Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Auth-Token: gAAAAABi1MVL9QOudEs7C2f_G3BU3lNbHMETzmL5WKlgYVHlof-nkDaHZRiSPFpkvEsl9XaT7pxqG77-yzm36QBBEeCOA0qlcvj9wDKOTS_8C76vKww6LRGfjOAHatsCuCf_svNYTvb3J2ji0mQjihM_5mcYJYRg71p2Zuskvh8iXSwksB8QLSM Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Domain-Id: None Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Domain-Name: None Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Identity-Status: Confirmed Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Is-Admin-Project: True Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Domain-Id: default Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Domain-Name: Default Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Project-Name: admin Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Role: admin,member,reader Jul 18 02:28:28.000607 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Roles: admin,member,reader Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a05e40a15656441b94f5763e4d68d305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a05e40a15656441b94f5763e4d68d305", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Tenant: admin Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Tenant-Id: a05e40a15656441b94f5763e4d68d305 Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-Tenant-Name: admin Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User: admin Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Domain-Id: default Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Domain-Name: Default Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Id: 62dd67591e0147fe97b248079359a4de Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: X-User-Name: admin Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: method: > Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: exception: Flavor 451 could not be found. Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: action_args: {'id': '451'} Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:28:28.002212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:28.003818 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: ERROR nova.api.openstack.wsgi Jul 18 02:28:28.005195 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-c2f9e0d9-4f45-4ad2-a069-50f14e0cf6fc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:28:28.006506 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-c2f9e0d9-4f45-4ad2-a069-50f14e0cf6fc admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011954 Jul 18 02:28:28.006506 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 18 02:28:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:28.973363 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:28.974422 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 18 02:28:28.974818 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:29.495833 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-58f6aede-1f81-422a-90d0-ebb2b687b769 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:29.587305 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-58f6aede-1f81-422a-90d0-ebb2b687b769 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.474633 Jul 18 02:28:29.587858 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 18 02:28:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:28:30.552263 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:30.553265 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 18 02:28:30.553661 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:31.076465 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-c6874c74-c756-405f-b62b-0c0198bf61d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:31.151772 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-c6874c74-c756-405f-b62b-0c0198bf61d0 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.459069 Jul 18 02:28:31.152316 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 18 02:28:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:28:32.118230 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:32.119238 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 18 02:28:32.119635 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:28:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:32.645053 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-5b33c2b9-660b-40e1-be66-369a23ea398a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:32.705830 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-5b33c2b9-660b-40e1-be66-369a23ea398a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.444289 Jul 18 02:28:32.706414 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 18 02:28:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:28:33.678531 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:33.679522 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 18 02:28:33.679914 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:28:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:34.200413 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-7787cc67-9459-4254-879f-630d1b12ce1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:28:34.255313 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-7787cc67-9459-4254-879f-630d1b12ce1c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.437292 Jul 18 02:28:34.255973 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 18 02:28:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:28:35.235227 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:35.236231 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jul 18 02:28:35.236628 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:28:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:28:35.759945 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-6aed1b40-f8dc-4e9f-bfac-cca9dc3e7146 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:28:35.779674 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-6aed1b40-f8dc-4e9f-bfac-cca9dc3e7146 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406465 Jul 18 02:28:35.780212 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Mon Jul 18 02:28:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:29:27.283078 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.284074 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-cb58061d-4a92-4eaa-92a0-998adc819141 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jul 18 02:29:27.284464 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 18 02:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:29:27.295935 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:27.678603 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-797a62a9-c4a6-4219-994c-a68cd4ea73b2 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.697555 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-797a62a9-c4a6-4219-994c-a68cd4ea73b2 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406762 Jul 18 02:29:27.698034 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 18 02:29:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:29:27.721622 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-b2b43a6b-0d0e-4593-be0e-6c32a48b1a65 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.725008 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG dbcounter [-] [103900] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:27.729928 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-b2b43a6b-0d0e-4593-be0e-6c32a48b1a65 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011848 Jul 18 02:29:27.730475 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1282 bytes} [Mon Jul 18 02:29:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:27.742061 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-1421d2e7-7f8f-49b9-b35a-cf848979a8e8 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.750053 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-1421d2e7-7f8f-49b9-b35a-cf848979a8e8 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011640 Jul 18 02:29:27.750605 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1285 bytes} [Mon Jul 18 02:29:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:29:27.761872 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-91809f23-d238-4bfb-8104-111b4c96f4d1 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.770337 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-91809f23-d238-4bfb-8104-111b4c96f4d1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011857 Jul 18 02:29:27.770854 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1285 bytes} [Mon Jul 18 02:29:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:29:27.782631 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-d164ea73-6102-48f6-917e-7478b6368831 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:29:27.790583 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-d164ea73-6102-48f6-917e-7478b6368831 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012160 Jul 18 02:29:27.791220 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1282 bytes} [Mon Jul 18 02:29:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:32:58.654331 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-91809f23-d238-4bfb-8104-111b4c96f4d1 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:58.655376 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-91809f23-d238-4bfb-8104-111b4c96f4d1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001835 Jul 18 02:32:58.655776 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:32:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:32:58.798180 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writing DB stats nova_api:SELECT=6 {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:58.959626 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-3268097e-2a1e-4202-80e3-2dbf48cae9d9 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:58.966230 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:32:58.966230 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: warnings.warn(msg) Jul 18 02:32:58.966230 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-3268097e-2a1e-4202-80e3-2dbf48cae9d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.966230 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-3268097e-2a1e-4202-80e3-2dbf48cae9d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.966230 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-3268097e-2a1e-4202-80e3-2dbf48cae9d9 admin admin] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:32:58.966230 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-3268097e-2a1e-4202-80e3-2dbf48cae9d9 admin admin] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:32:58.998563 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-3268097e-2a1e-4202-80e3-2dbf48cae9d9 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201613 Jul 18 02:32:58.999341 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 36/70] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 18 02:32:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:32:59.826462 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-91809f23-d238-4bfb-8104-111b4c96f4d1 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:32:59.827469 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-91809f23-d238-4bfb-8104-111b4c96f4d1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 18 02:32:59.827863 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:32:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:00.018334 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-d2f6c371-6d80-4705-8754-a0491f93b2e9 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:00.019504 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:33:00.019504 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: warnings.warn(msg) Jul 18 02:33:00.020687 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-d2f6c371-6d80-4705-8754-a0491f93b2e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:00.021151 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-d2f6c371-6d80-4705-8754-a0491f93b2e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:00.021940 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-d2f6c371-6d80-4705-8754-a0491f93b2e9 admin admin] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:00.022393 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-d2f6c371-6d80-4705-8754-a0491f93b2e9 admin admin] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:00.043383 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-d2f6c371-6d80-4705-8754-a0491f93b2e9 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076148 Jul 18 02:33:00.043931 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 37/72] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 18 02:32:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:33:11.299160 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-91809f23-d238-4bfb-8104-111b4c96f4d1 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:11.300192 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-91809f23-d238-4bfb-8104-111b4c96f4d1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 18 02:33:11.300584 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 36/73] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:33:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:11.446702 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writing DB stats nova_cell0:SELECT=4 {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:11.447455 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writing DB stats nova_cell1:SELECT=4 {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:11.448091 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG dbcounter [-] [103899] Writing DB stats nova_api:SELECT=8 {{(pid=103899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:33:11.495890 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-9220b833-c882-4db7-a2bd-f773e900be29 admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:11.497058 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:33:11.497058 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: warnings.warn(msg) Jul 18 02:33:11.498288 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-9220b833-c882-4db7-a2bd-f773e900be29 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:11.498731 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-9220b833-c882-4db7-a2bd-f773e900be29 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:11.499519 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-9220b833-c882-4db7-a2bd-f773e900be29 admin admin] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:11.499945 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-9220b833-c882-4db7-a2bd-f773e900be29 admin admin] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:11.525839 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-9220b833-c882-4db7-a2bd-f773e900be29 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084412 Jul 18 02:33:11.526437 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 38/74] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 18 02:33:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:33:12.352546 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: DEBUG nova.api.openstack.wsgi [None req-91809f23-d238-4bfb-8104-111b4c96f4d1 admin admin] Calling method '>' {{(pid=103900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:12.353532 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: INFO nova.api.openstack.requestlog [None req-91809f23-d238-4bfb-8104-111b4c96f4d1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001903 Jul 18 02:33:12.353927 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: [pid: 103900|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 18 02:33:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:33:12.543319 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG nova.api.openstack.wsgi [None req-49da9b07-0083-48df-adf1-f84d335e12ba admin admin] Calling method '>' {{(pid=103899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:33:12.544550 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:33:12.544550 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: warnings.warn(msg) Jul 18 02:33:12.545770 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-49da9b07-0083-48df-adf1-f84d335e12ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.546248 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-49da9b07-0083-48df-adf1-f84d335e12ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.547045 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-49da9b07-0083-48df-adf1-f84d335e12ba admin admin] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:33:12.547497 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: DEBUG oslo_concurrency.lockutils [None req-49da9b07-0083-48df-adf1-f84d335e12ba admin admin] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:33:12.570131 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: INFO nova.api.openstack.requestlog [None req-49da9b07-0083-48df-adf1-f84d335e12ba admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079551 Jul 18 02:33:12.570710 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: [pid: 103899|app: 0|req: 39/76] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 18 02:33:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:34:08.171043 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: Mon Jul 18 02:34:08 2022 - graceful shutdown triggered... Jul 18 02:34:08.171543 dv-cinder-850015-3-iscsi devstack@n-api.service[103900]: Gracefully killing worker 2 (pid: 103900)... Jul 18 02:34:08.171163 dv-cinder-850015-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 02:34:08.172388 dv-cinder-850015-3-iscsi devstack@n-api.service[103899]: Gracefully killing worker 1 (pid: 103899)... Jul 18 02:34:09.172190 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: worker 1 buried after 1 seconds Jul 18 02:34:09.172721 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: worker 2 buried after 1 seconds Jul 18 02:34:09.172721 dv-cinder-850015-3-iscsi devstack@n-api.service[103898]: goodbye to uWSGI. Jul 18 02:34:09.173767 dv-cinder-850015-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 02:34:09.174348 dv-cinder-850015-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 02:34:09.177295 dv-cinder-850015-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 02:34:09.186461 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 02:34:09.189042 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 02:34:09 2022] *** Jul 18 02:34:09.189199 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 02:34:09.189917 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 02:34:09.189917 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: nodename: dv-cinder-850015-3-iscsi Jul 18 02:34:09.189917 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: machine: x86_64 Jul 18 02:34:09.189917 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: clock source: unix Jul 18 02:34:09.189917 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: pcre jit disabled Jul 18 02:34:09.189917 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: detected number of CPU cores: 4 Jul 18 02:34:09.189917 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: current working directory: / Jul 18 02:34:09.189917 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: detected binary path: /usr/bin/uwsgi-core Jul 18 02:34:09.189917 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: your processes number limit is 47680 Jul 18 02:34:09.189917 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: your memory page size is 4096 bytes Jul 18 02:34:09.190716 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: detected max file descriptor number: 2048 Jul 18 02:34:09.190716 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: lock engine: pthread robust mutexes Jul 18 02:34:09.190716 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: thunder lock: enabled Jul 18 02:34:09.190716 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 02:34:09.190716 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 02:34:09.231705 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: Python main interpreter initialized at 0x5584e57a39c0 Jul 18 02:34:09.231705 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: python threads support enabled Jul 18 02:34:09.231705 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: your server socket listen backlog is limited to 100 connections Jul 18 02:34:09.231705 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: your mercy for graceful operations on workers is 90 seconds Jul 18 02:34:09.232143 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 02:34:09.232143 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: *** Operational MODE: preforking *** Jul 18 02:34:09.232416 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: *** uWSGI is running in multiple interpreter mode *** Jul 18 02:34:09.232416 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: spawned uWSGI master process (pid: 124874) Jul 18 02:34:09.232623 dv-cinder-850015-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 02:34:09.233236 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: spawned uWSGI worker 1 (pid: 124890, cores: 1) Jul 18 02:34:09.233834 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: spawned uWSGI worker 2 (pid: 124891, cores: 1) Jul 18 02:34:09.234229 dv-cinder-850015-3-iscsi devstack@n-api.service[124874]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 02:34:09.909992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 02:34:09.910723 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 02:34:11.090921 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:34:11.090921 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: from cryptography.utils import int_from_bytes Jul 18 02:34:11.091634 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:34:11.091634 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: from cryptography.utils import int_from_bytes Jul 18 02:34:11.141028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:34:11.141028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: from cryptography.utils import int_from_bytes Jul 18 02:34:11.141655 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:34:11.141655 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: from cryptography.utils import int_from_bytes Jul 18 02:34:13.392319 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 02:34:13.392757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 02:34:13.393123 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 02:34:13.393493 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 02:34:13.393754 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 02:34:13.394897 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.395021 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.395320 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.395643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.395977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.396290 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.396622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.396943 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.397274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.397539 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.397866 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.398213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850015-3-iscsi {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.398539 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.398847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.399158 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.399480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.400041 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.400364 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.400671 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.401177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.402692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.402692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.402692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.402692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.403032 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.403271 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.403504 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.403819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.404153 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.404442 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.404860 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850015-3-iscsi {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.405157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.405470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.405781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.406217 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.406542 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.406842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.407166 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.407487 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.407797 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.408125 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.408448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.408781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.409106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.409396 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.410315 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.410895 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.411244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.411561 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.411873 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.412129 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.412442 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.412768 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.413095 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.413421 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.413677 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.413934 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.414282 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.414608 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.414922 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.415233 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.415544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.415851 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.416161 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.416479 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.416783 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.417087 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.417407 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.417726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.418047 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.418380 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.419434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.419434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.419434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.419871 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.420033 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.420268 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.420574 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.420908 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.421218 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.421521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.421827 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.422169 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.422494 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.422816 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.423121 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.423375 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.423675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.423980 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.424299 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.424606 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.424926 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.425325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.425677 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.426015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.426302 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.426615 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.426920 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.427226 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.427532 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.427840 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.428140 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.428444 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.428767 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.429087 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.429394 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.429699 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.430006 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.430349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.430680 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.431113 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.431429 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.431751 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.432065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.432373 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.432693 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.432996 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.433304 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.433624 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.433925 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.434255 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.434577 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.434883 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.435183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.435488 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.435793 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.436096 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.436408 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.436713 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.437017 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.437317 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.437635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.437956 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.438290 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.438598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.438908 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.439225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.439562 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.439894 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.440238 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.440553 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.440915 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.441244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.441705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.442018 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.442359 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.442690 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.443005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.443320 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.443635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.444268 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.444595 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.444933 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.445253 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.445573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.445897 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.446235 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.446562 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.446897 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.447226 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.447540 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.447885 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.448235 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.448551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.448879 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.449205 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.449520 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.449833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.450175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.450502 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.450840 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.451155 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.451475 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.451792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.452106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.452419 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.452733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.453047 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.453387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.453703 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.454022 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.454436 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.454754 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.455066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.455376 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.455687 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.455993 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.456302 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.457303 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.457729 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.458046 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.458404 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.458728 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.459043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.459381 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.459691 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.460006 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.460318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.460630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.460937 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.461252 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.461563 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.461871 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.462219 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.462532 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.462845 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.463162 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.463469 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.463777 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.464180 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.464397 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.464711 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.465121 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.465332 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.465658 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.465973 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.466320 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.466663 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.466999 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.467309 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.467634 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.467962 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.468282 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.468590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.468899 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.469312 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.469620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.469877 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.470213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.470517 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.470823 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.471130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.471372 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 02:34:13.471841 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.471962 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 02:34:13.472146 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.472146 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.472832 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 02:34:13.472932 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.473093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 02:34:13.473529 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.473642 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 02:34:13.473741 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.473840 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.473939 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.474155 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.474276 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.474479 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.474574 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.474798 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.474905 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.475130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.475224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.475441 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.475537 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.475763 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.475874 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.476081 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.476185 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.476398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.476501 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.476659 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.476754 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.476974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.477068 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.477300 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850015-3-iscsi {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.477420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.477617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.477733 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.477924 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.478027 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.478285 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.478411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.478569 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.478666 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.478875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.478971 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.479196 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.479306 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.479502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.479597 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.479820 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.480006 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.480127 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.480317 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.480424 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.480629 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.480756 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.480940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.481091 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.481277 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.481412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.481591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.481736 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.481899 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.482049 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.482243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.482386 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.482553 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.482699 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.482878 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.483013 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.483188 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.483322 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.483584 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850015-3-iscsi {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.483680 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.483900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.484007 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.484213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.484357 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.484527 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.484641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.484844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.484961 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.485167 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.485313 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.485476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.485623 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.485796 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.485944 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.486129 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.486277 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.486426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.486571 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.486755 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.486893 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.487087 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.487192 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.487401 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.487519 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.488271 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.488445 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.488686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.488907 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.488993 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.489214 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.489358 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.489436 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.489558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.489863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.490199 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.490455 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.490641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.490796 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.490954 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.491106 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.491266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.491428 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.491588 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.491739 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.491900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.492157 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.492318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.492480 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.492578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.492661 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.492775 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.493081 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.493391 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.493580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.493759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.493930 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.494142 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.494327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.494447 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.494630 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.494734 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.494895 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.495046 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.495199 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.495415 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.495525 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.495821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.495948 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.496151 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.496323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.496462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.496564 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.496749 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.496844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.497132 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.497234 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.497395 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.497501 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.497702 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.497807 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.498037 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.498176 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.498394 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.498505 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.498691 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.498823 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.498999 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.499163 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.499311 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.499452 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.499598 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.499747 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.499886 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.500037 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.500176 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.500326 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.500491 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.500631 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.500813 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.500968 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.501118 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.501260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.501402 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.501536 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.501688 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.501830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.501978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.502165 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.502316 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.502463 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.502614 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.502766 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.502907 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.503055 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.503203 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.503416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.503609 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.503762 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.503902 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.504043 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.504192 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.504346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.504495 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.504636 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.504796 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.504944 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.505085 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.505234 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.505382 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.505523 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.505663 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.505812 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.505960 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.506132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.506298 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.506392 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.506701 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.506886 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.507009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.507227 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.507327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.507550 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.507670 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.507876 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.507984 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.508201 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.508295 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.508529 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.508663 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.508830 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.508936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.509150 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.509247 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.509455 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.509551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.509759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.509870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.510076 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.510258 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.510402 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.510499 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.510723 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.510833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.511029 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.511132 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.511330 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.511424 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.511634 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.511743 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.511941 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.512042 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.512243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.512362 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.512547 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.512655 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.512844 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.512938 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.513148 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.513243 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.513449 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.513555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.513751 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.513845 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.514050 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.514183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.514377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.514486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.514674 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.514777 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.514993 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.515100 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.515300 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.515401 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.515607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.515703 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.515908 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.516001 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.516212 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.516315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.516527 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:34:13.516636 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.516855 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.516969 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.517183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.517357 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.517507 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.517657 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.517824 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.517978 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.518178 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.518274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.518498 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.518740 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.518849 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.519487 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.519642 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.519812 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.519983 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.520123 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.520256 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.520378 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.520566 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.520703 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.520873 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.520964 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.521180 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.521496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.521810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.521982 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.522186 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.522352 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.522519 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.522680 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.522838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.522986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.523142 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.523298 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.523467 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.523615 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.523776 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.523932 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.524090 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.524247 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.524453 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.524615 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.525041 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.525283 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.525445 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.525603 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.525768 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.525917 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.526077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.526077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.526389 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.526555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.526711 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.526882 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.527117 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.527215 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.527323 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.527423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.527513 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.527600 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.527694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.527782 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.527868 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.528123 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.528237 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.528346 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.528436 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.528657 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.528777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.528995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.529137 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.529258 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.529349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.529584 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.529865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.530022 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.530210 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.530315 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.530416 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.530505 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.530600 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.530783 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.530877 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.531108 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.531209 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.531427 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.531529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.531733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.531825 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.532061 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.532195 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.532352 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.532489 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.532658 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.532742 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.532964 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.533074 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.533273 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.533374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.533587 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.533680 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.533879 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.533970 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.534323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.534438 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.535112 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.535210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.535405 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.535512 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.535723 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.535945 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.536163 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.536264 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.536507 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.536601 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.536816 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.536930 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.537181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.537275 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.537458 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.537562 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.537742 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.537840 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.538057 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.538390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.538517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.538646 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.538787 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.538891 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.538991 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.539092 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.539302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.539466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.539625 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.539716 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.539933 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.540063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.540239 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.540404 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.540562 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.540665 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.540871 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.540968 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.541176 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.541279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.541491 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.541592 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.541797 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.541895 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.542127 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.542316 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.542495 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.542654 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.542802 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.542948 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.543112 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.543266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.543410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.543564 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.543708 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.543853 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.544005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.544155 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.544317 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.544469 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.544620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.544772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.544917 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.545059 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.545211 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.545365 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.545530 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.545632 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.545827 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.545972 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.546152 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.546315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.546468 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.546621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.546774 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.546929 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.547073 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.547232 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.547524 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.547686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.547841 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.547992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.548142 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.548307 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.548466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.548613 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.548613 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.548890 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.549056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.549199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.549199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.549466 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.549466 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.549760 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.549913 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.550068 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.550821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.550978 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.550978 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.551172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.551172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.551324 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.551481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.551586 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.551824 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.551927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.552155 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.552264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.552469 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.552564 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.552781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.552877 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.553094 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.553201 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.553406 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.553506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.553714 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.553809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.554025 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.554159 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.554366 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.554470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.554679 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.554782 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.555001 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.555111 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.555314 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.555410 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.555633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.555735 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.555944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.556038 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.556267 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.556368 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.556570 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.556671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.556881 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.556976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.557187 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.557289 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.557516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.557628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.557805 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.557907 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.558147 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.558247 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.558486 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.558578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.558808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.558905 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.559120 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.559215 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.559435 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.559565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.559745 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.559875 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.560055 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.560186 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.560365 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.560510 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.560677 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.560833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.561001 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.561158 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.561310 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.561464 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.561627 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.561785 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.561919 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.562104 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.562269 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.562439 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.562581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.562766 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.562898 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.563078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.563201 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.563394 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.563515 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.563701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.564027 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.564352 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.564590 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.564726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.564929 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.565053 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.565241 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.565380 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.565546 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.565831 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.566482 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.566661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.566785 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.566989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.567130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.567320 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.567443 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.567661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.567792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.567921 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.568045 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.568232 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.568341 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.568538 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.568634 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.568846 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.568950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.569155 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.569253 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.569463 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.569558 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.569774 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.569870 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.570119 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.570265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.570530 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.570844 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.571160 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.571465 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.571787 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.572110 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.572401 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.572491 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.572752 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.572937 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.573129 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.573321 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.573474 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.573635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.573807 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.573953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.574119 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.574214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.574360 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.574528 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.574688 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.574788 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.575002 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.575094 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.575311 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.575417 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.575618 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.575717 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.575927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.576020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.576269 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.576370 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.576579 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.576672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.576900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.576994 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.577225 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.577319 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.577538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.577630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.577856 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.577962 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.578255 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.578362 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.578511 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.578619 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.578839 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.578943 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.579156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.579249 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.579468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.579589 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.579780 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.579890 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.580091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.580219 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.580400 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.580496 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.580707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.580812 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.581012 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.581106 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.581321 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.581615 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.581709 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.581872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.581965 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.582058 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.582289 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.582388 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.582595 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.582702 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.582922 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.583025 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.583230 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.583557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.583659 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.583869 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.583966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.584177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.584271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.584482 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.584591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.584785 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.584888 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.585130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.585441 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.585538 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.585774 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.586045 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.586174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.586429 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.586535 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.586763 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.586868 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.587073 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.587178 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.587392 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.587494 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.587704 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.587800 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.588019 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.588124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.588338 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.588510 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.588661 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.588826 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.588959 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.589103 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.589259 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.589407 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.589562 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.589708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.589868 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.590015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.590308 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.590428 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.590510 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.590595 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.590747 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.590854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.591070 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.591326 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.591422 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.591658 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.591758 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.591974 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.592077 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.592289 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.592372 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.592600 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.592690 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.593595 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.593700 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.593784 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.593858 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.593937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.594011 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.594011 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.594186 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.594273 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.594350 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.594422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.594508 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.594740 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.594824 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.595063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.595154 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.595389 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.595482 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.595716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.595799 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.596031 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.596121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.596339 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.596441 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.596645 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.596750 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.596948 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.597086 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.597332 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.597430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.597653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.597807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.598041 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.598159 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.598337 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.598620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.598965 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.599248 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.599568 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.599869 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.600182 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.600508 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.602143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.602143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.602143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.602143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.602143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.602925 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.602925 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.603127 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.603304 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.603859 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.604176 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.604511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.604837 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.605166 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.605486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.605807 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.610426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.610426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.610654 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.610848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.610954 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611046 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611135 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611234 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611234 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611500 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611683 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611877 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.611971 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.612058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.612058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.612221 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.612221 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.612384 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.612472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.612556 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613182 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613920 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.613920 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.614128 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.617453 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.618326 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.618502 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.618659 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.618829 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.618982 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.619134 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.619302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.619463 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.619463 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.619757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.619919 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.620076 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.620236 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.620393 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.620550 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.620707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.620864 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.621013 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.621177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.621334 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.621511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.621752 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.621914 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.622158 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.622321 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.622321 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.631045 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.631250 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.631417 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.631586 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.631758 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.632004 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.632166 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.632323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.632323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.632630 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.632810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.632968 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.633127 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.633284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.633284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.633575 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.633731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.633882 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.633882 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.634217 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.634368 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.634551 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.634816 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.635079 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.635234 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.635390 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.635559 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.635717 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.635875 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.636034 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.636192 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.636341 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.636500 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.636658 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.636815 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.636985 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.637142 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.637300 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.637464 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.637640 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.637875 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.638039 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.638039 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.638423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.638591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.638742 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.638899 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.639057 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.639309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.639486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.639638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.639794 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.639985 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.640363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.640521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.640682 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.640682 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.640965 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.641114 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.641262 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.641431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.641431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.641431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.641858 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.642024 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.642024 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.642494 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.642665 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.642861 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.643013 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.643170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.643329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.643494 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.643664 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.643816 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.644012 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.644195 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.644386 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.644550 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.644700 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.644940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.645119 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.645408 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.645568 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.645729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.645879 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.646049 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.646300 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.646453 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.646617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.646766 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.646923 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.646923 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.647204 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.647353 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.647566 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.647730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.647908 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.648143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.648308 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.648467 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.648626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.648776 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.648931 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.649087 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.649236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.649398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.649548 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.649548 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.650110 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.650491 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.650670 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.650836 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.650986 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.651135 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.651292 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.651441 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.651590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.651753 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.651910 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.652068 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.652225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.653052 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.653175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.653375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.653496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.653496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.653722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.653837 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.653966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.653966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.658825 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.658825 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.659136 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.659294 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.659543 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.659718 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.659878 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.660037 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.660188 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.660355 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.660748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.660915 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.661082 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.661238 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.661393 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.661549 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.661714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.661871 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.662037 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.662220 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.662377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.662550 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.662731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.663188 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.663354 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.663519 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.663675 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.663844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.664009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.664166 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.664166 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.664483 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.664640 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.664804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.664981 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.665292 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.665461 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.665761 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.665934 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.666173 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.666397 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.666578 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.666744 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.666913 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.667080 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.667080 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.667388 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.667551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.667708 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.667865 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.668030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.668187 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.668439 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.668601 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.668765 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.668765 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.669096 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.669096 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.669403 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.669570 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.669727 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.669883 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.670048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.670230 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.670388 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.670555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.670555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.671213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.671437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.671598 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.671761 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.671916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.672080 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.672251 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.672416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.672575 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.673515 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.673701 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.673948 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.674304 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.674483 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.674651 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.674808 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.674979 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.675973 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.676149 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.676307 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.676472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.676629 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.676800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.676964 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.677142 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.677299 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.677463 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.677630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.677789 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.677955 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.678131 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.678295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.678482 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.678748 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.678914 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.679077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.679243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.679412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.679582 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.679749 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.679908 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.680071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.680237 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.680403 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.680575 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.680733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.680733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.681426 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.681590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.681761 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.681952 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.682211 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.682375 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.682531 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.682696 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.682853 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.683020 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.683186 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.683343 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.683637 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.683801 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.683957 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.684137 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.684295 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.684459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.684624 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.684788 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.684955 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.685114 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.685279 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.685436 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.685601 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.685795 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.686362 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.686532 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.686712 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.686871 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687200 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687533 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 02:34:13.687699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.687699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.689056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.689056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.689056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.689056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.689056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.689056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.689056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.689056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.690481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.690481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.690481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.690481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.690481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.690481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.690481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.690481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.693181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.693181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.693181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.693181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.693181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.693181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.693181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.693181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.694698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.694698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.694698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.694698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.694698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.694698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.694698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.694698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.695867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.695867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.695867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.695867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.695867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.695867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.695867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.695867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.697462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.697462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.697462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.697462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.697462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.697462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.697462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.697462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.698685 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.698685 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.698685 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.698685 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.698685 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.698685 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.698685 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.698685 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.700017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.700017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.700017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.700017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.700017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.700017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.700017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.700017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.701206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.701206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.701206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.701206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.701206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.701206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.701206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.702681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.702681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.702681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.702681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.702681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.702681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.702681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.702681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.703987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.703987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.703987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.703987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.703987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.704733 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.704733 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.705050 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.705349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.705670 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.705993 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.706710 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.706710 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.707032 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.707340 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.707640 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.707952 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.709415 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.709415 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.709415 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.709415 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.710149 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.710149 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.710149 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.710708 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.711053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.711375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.711702 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.712028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.712588 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.712788 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.713121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.713434 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.713741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.714071 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.714393 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.714698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.715004 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.715316 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.715626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.715928 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.716236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.716734 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.717061 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.717223 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.717446 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.717750 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.718061 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.718386 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.718690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.718996 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.719297 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.719611 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.719911 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.720221 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.720524 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.720833 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.721137 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.721485 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.721840 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.723585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.723585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.723585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.724049 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.724338 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.724509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.724710 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.725014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.725383 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.725679 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.726294 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.729098 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.729098 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.729098 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.729098 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.729098 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.729098 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.729098 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.731091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.731091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.731091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.731091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.731091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.731091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.731091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.732236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.732236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.732236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.732236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.732926 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.732926 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.733352 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.733795 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.733959 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.734275 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.734656 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.734975 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.735292 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.735604 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.735915 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.736228 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.736538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.736854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.737186 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.737501 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.738592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.739338 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.739338 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.739683 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.739864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.740153 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.740474 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.740799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.741111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.742078 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.742078 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.742078 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.742610 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.742841 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.743195 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.744142 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.746122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.746122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.746122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.746122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.746122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.746122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.746688 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.746784 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.747090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.747408 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.747728 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.748048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.748370 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.748687 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.749002 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.749318 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.749631 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.749943 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.750288 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.750607 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.750920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.751234 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.751545 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.751858 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.752170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.752523 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.752867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.753193 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.754270 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.754608 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.754983 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.755264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.755592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.755922 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.756251 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.756570 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.756911 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.757230 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.757549 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.757866 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.758211 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.758533 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.758853 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.759193 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.759527 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.760422 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.760422 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.760584 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.760856 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.761105 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.761424 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.761760 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.762079 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.762420 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.762738 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.763054 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.763370 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.763689 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.764005 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.764329 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.764652 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.764973 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.765569 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.765691 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.765941 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.766309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.766665 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.766992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.767310 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.767664 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.767997 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.768317 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.768636 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.769055 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:34:13.769772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 02:34:13.817785 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO dbcounter [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Registered counter for database nova_api Jul 18 02:34:13.839277 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_db.sqlalchemy.engines [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:34:13.846377 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writer thread running {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:34:13.904819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.context [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96635aa1-f097-4770-8a14-36db95b56343(cell1) {{(pid=124890) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 02:34:13.908766 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:13.910436 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:13.911243 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:13.913214 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:13.915204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO dbcounter [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Registered counter for database nova_cell0 Jul 18 02:34:13.919309 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO dbcounter [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Registered counter for database nova_cell1 Jul 18 02:34:13.920502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO dbcounter [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Registered counter for database nova_api Jul 18 02:34:13.926779 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_db.sqlalchemy.engines [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:34:13.928088 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_db.sqlalchemy.engines [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:34:13.934692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writer thread running {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:34:13.936318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writer thread running {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:34:13.940524 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_db.sqlalchemy.engines [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:34:13.947624 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writer thread running {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:34:14.004788 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.context [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96635aa1-f097-4770-8a14-36db95b56343(cell1) {{(pid=124891) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 02:34:14.008763 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:14.010369 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:14.011209 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:34:14.013179 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:34:14.015177 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO dbcounter [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Registered counter for database nova_cell0 Jul 18 02:34:14.019835 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO dbcounter [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Registered counter for database nova_cell1 Jul 18 02:34:14.027536 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_db.sqlalchemy.engines [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:34:14.028844 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_db.sqlalchemy.engines [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:34:14.035675 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writer thread running {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:34:14.037188 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writer thread running {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:34:14.083033 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO dbcounter [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Registered counter for database nova_cell0 Jul 18 02:34:14.089689 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_db.sqlalchemy.engines [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:34:14.094148 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writer thread running {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:34:14.184161 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO dbcounter [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Registered counter for database nova_cell0 Jul 18 02:34:14.190778 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_db.sqlalchemy.engines [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:34:14.195288 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writer thread running {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:34:14.423121 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: WARNING keystonemiddleware.auth_token [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:34:14.430605 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: WARNING keystonemiddleware.auth_token [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:34:14.514359 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: WARNING keystonemiddleware.auth_token [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:34:14.522345 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: WARNING keystonemiddleware.auth_token [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:34:14.777709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: WARNING keystonemiddleware.auth_token [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:34:14.783936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: WARNING keystonemiddleware.auth_token [None req-3d513e67-eae9-4e2f-a99a-b373547875aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:34:14.789842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5584e57a39c0 pid: 124890 (default app) Jul 18 02:34:14.867300 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: WARNING keystonemiddleware.auth_token [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 02:34:14.873313 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: WARNING keystonemiddleware.auth_token [None req-50753fbd-6ec0-48ca-9227-78c8f06fb5c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 02:34:14.879187 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5584e57a39c0 pid: 124891 (default app) Jul 18 02:34:57.560784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=3 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:57.561911 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=3 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:57.564992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=3 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:57.566727 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=3 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:58.486849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-461cad99-f756-423e-949a-22da40f9eb3b tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Action: 'create', calling method: .version_select at 0x7f28f057b8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-481777460"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:34:59.856673 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-86612d25-6026-4d36-9ac1-6b68a03516f9 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f06ab3a0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:34:59.889777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=3 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:59.891884 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=3 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:59.893366 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=3 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:59.894320 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=3 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:00.113217 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-86612d25-6026-4d36-9ac1-6b68a03516f9 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/5b3fae81-50a8-471f-bc1f-b5931ce42a16" status: 200 len: 350 microversion: 2.1 time: 0.545114 Jul 18 02:35:00.115663 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 1/1] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:34:59 2022] GET /compute/v2.1/os-volumes/5b3fae81-50a8-471f-bc1f-b5931ce42a16 => generated 350 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:00.580522 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-461cad99-f756-423e-949a-22da40f9eb3b tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.830823 Jul 18 02:35:00.580522 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 1/2] 10.222.0.66 () {60 vars in 1154 bytes} [Mon Jul 18 02:34:57 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2833 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 18 02:35:00.583339 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f488f5e2-6a2f-4974-953d-45dd60f392de tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0487940>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:00.583339 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f488f5e2-6a2f-4974-953d-45dd60f392de tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a" status: 200 len: 344 microversion: 2.1 time: 0.151161 Jul 18 02:35:00.583339 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:00 2022] GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:01.560187 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-06e0fdfc-1db2-4206-9a81-501c3b16c021 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0444700>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:01.706559 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-06e0fdfc-1db2-4206-9a81-501c3b16c021 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a" status: 200 len: 345 microversion: 2.1 time: 0.150069 Jul 18 02:35:01.707478 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:01 2022] GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a => generated 345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:01.731157 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-dc5bc1b0-196d-49c4-b3c4-62fbd15935b7 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Action: 'create', calling method: .version_select at 0x7f28f044e040>, body: {"snapshot": {"volume_id": "4493d6d0-fc45-408a-8598-22a6a696586a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-479250120"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:02.251996 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ec790382-547e-4801-bb2b-29aedb5a9f3d tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f0444820>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:02.410334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ec790382-547e-4801-bb2b-29aedb5a9f3d tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/65c3e65e-4000-4568-ae7b-ae2ae9dafb72" status: 200 len: 351 microversion: 2.1 time: 0.156107 Jul 18 02:35:02.410334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 3/5] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:02 2022] GET /compute/v2.1/os-volumes/65c3e65e-4000-4568-ae7b-ae2ae9dafb72 => generated 351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:03.384275 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-dc5bc1b0-196d-49c4-b3c4-62fbd15935b7 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.668511 Jul 18 02:35:03.385146 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 3/6] 10.222.0.66 () {60 vars in 1161 bytes} [Mon Jul 18 02:35:01 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:03.401805 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-aec878b5-b438-41f5-9cf3-72065d84f5f2 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0444ee0>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:03.779842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-aec878b5-b438-41f5-9cf3-72065d84f5f2 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910" status: 200 len: 286 microversion: 2.1 time: 0.387426 Jul 18 02:35:03.781456 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 18 02:35:03 2022] GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 => generated 286 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:03.791316 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2be04c1f-8da2-4b7d-befe-1e8f2ad88427 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0487550>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:03.935950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2be04c1f-8da2-4b7d-befe-1e8f2ad88427 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.148569 Jul 18 02:35:03.936523 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1139 bytes} [Mon Jul 18 02:35:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:03.947588 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b06bb39e-f29b-4f72-bc7d-9d3319291506 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0459670>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:03.999917 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b06bb39e-f29b-4f72-bc7d-9d3319291506 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910" status: 200 len: 286 microversion: 2.1 time: 0.056058 Jul 18 02:35:04.000474 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 5/9] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 18 02:35:03 2022] GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:05.018921 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c87a1ab8-a7e9-4c62-a95a-802e38dc4249 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f044e5e0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:05.092613 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c87a1ab8-a7e9-4c62-a95a-802e38dc4249 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910" status: 200 len: 286 microversion: 2.1 time: 0.084218 Jul 18 02:35:05.093943 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 5/10] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 18 02:35:05 2022] GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:06.110038 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a88dbe66-a364-47a7-b818-e9f789a5fe0c tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0444c10>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:06.163071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a88dbe66-a364-47a7-b818-e9f789a5fe0c tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910" status: 200 len: 286 microversion: 2.1 time: 0.062293 Jul 18 02:35:06.167096 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 6/11] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 18 02:35:06 2022] GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:07.175471 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6ec6bdbe-6da0-4177-b812-b72cd933aeb6 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f044eaf0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:07.267301 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6ec6bdbe-6da0-4177-b812-b72cd933aeb6 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910" status: 200 len: 286 microversion: 2.1 time: 0.096931 Jul 18 02:35:07.270258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 18 02:35:07 2022] GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:08.302780 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7c980e3c-f4f5-4be8-a009-2538d4ee681f tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0444b80>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:08.379002 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8f3c079f-0ff9-4380-985e-6c39be202367 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f0487e50>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:08.413567 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7c980e3c-f4f5-4be8-a009-2538d4ee681f tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910" status: 200 len: 287 microversion: 2.1 time: 0.128550 Jul 18 02:35:08.414603 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 18 02:35:08 2022] GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:08.424949 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-984c7fb7-2be4-4363-8c4a-570e41d9e6e8 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0459700>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:08.514875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8f3c079f-0ff9-4380-985e-6c39be202367 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/46853438-198b-4efd-99df-38e055fbe179" status: 200 len: 350 microversion: 2.1 time: 0.139742 Jul 18 02:35:08.515947 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 7/14] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:08 2022] GET /compute/v2.1/os-volumes/46853438-198b-4efd-99df-38e055fbe179 => generated 350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:08.528043 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a3291259-df31-4194-846a-a577e99b0480 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f0487550>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:08.730682 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-984c7fb7-2be4-4363-8c4a-570e41d9e6e8 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910" status: 202 len: 0 microversion: 2.1 time: 0.309845 Jul 18 02:35:08.731264 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 8/15] 10.222.0.66 () {58 vars in 1253 bytes} [Mon Jul 18 02:35:08 2022] DELETE /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:35:08.741163 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b070f0fb-dd5e-422e-88e6-861eb91630af tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0459d30>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:08.848887 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b070f0fb-dd5e-422e-88e6-861eb91630af tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910" status: 200 len: 286 microversion: 2.1 time: 0.112085 Jul 18 02:35:08.852716 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 9/16] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 18 02:35:08 2022] GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 => generated 286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:08.910205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a3291259-df31-4194-846a-a577e99b0480 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.385842 Jul 18 02:35:08.910318 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 8/17] 10.222.0.66 () {58 vars in 1133 bytes} [Mon Jul 18 02:35:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:08.926449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-820ddcd9-42f4-47fa-b27a-e4c27cbe6fe0 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f0459ca0>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:09.084674 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-820ddcd9-42f4-47fa-b27a-e4c27cbe6fe0 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.162471 Jul 18 02:35:09.085486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 10/18] 10.222.0.66 () {58 vars in 1148 bytes} [Mon Jul 18 02:35:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:09.103890 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-870237dd-e9fb-429b-a585-663bf53101c2 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f044e5e0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:09.241884 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-870237dd-e9fb-429b-a585-663bf53101c2 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.141692 Jul 18 02:35:09.242490 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 9/19] 10.222.0.66 () {58 vars in 1133 bytes} [Mon Jul 18 02:35:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:09.255378 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b0d4f571-ec6b-49b2-ae9a-a5d772a5ca60 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f05ae1f0>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:09.468580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b0d4f571-ec6b-49b2-ae9a-a5d772a5ca60 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.217486 Jul 18 02:35:09.476219 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 11/20] 10.222.0.66 () {58 vars in 1166 bytes} [Mon Jul 18 02:35:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:09.481360 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6b9c8cb8-6dd9-4b2a-a5a8-336f3083ca9e tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f044e3a0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:09.619553 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6b9c8cb8-6dd9-4b2a-a5a8-336f3083ca9e tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.141781 Jul 18 02:35:09.621250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 10/21] 10.222.0.66 () {58 vars in 1169 bytes} [Mon Jul 18 02:35:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:09.635576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5c5c0797-8954-4022-bf23-d05f64cd8e37 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f04691f0>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:09.747528 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5c5c0797-8954-4022-bf23-d05f64cd8e37 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.117014 Jul 18 02:35:09.748116 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 12/22] 10.222.0.66 () {58 vars in 1154 bytes} [Mon Jul 18 02:35:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:09.760740 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4dff95da-b495-4d99-81cd-350ce94ad662 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f0487280>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:09.861675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-649c2641-5048-49cc-80e4-f9f0295ffe47 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f04449d0>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:09.886558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4dff95da-b495-4d99-81cd-350ce94ad662 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.129766 Jul 18 02:35:09.895302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 11/23] 10.222.0.66 () {58 vars in 1187 bytes} [Mon Jul 18 02:35:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:09.901466 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c781f6d6-0229-430e-b0a1-0c7b4aa63e99 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] Calling method '.version_select at 0x7f28f04641f0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:09.909598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-649c2641-5048-49cc-80e4-f9f0295ffe47 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] HTTP exception thrown: Snapshot aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 could not be found. Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-649c2641-5048-49cc-80e4-f9f0295ffe47 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Request method failure captured: Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 HTTP/1.1 Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbRN6ZiHwf1AhwiKU1-Ijtdop6hddj5Tz-uKkmRaVLifMypBmlorlqawhKbOpLo-LECCtzczPUgf_6pwrbkcDIX6YB1oQPob73hVEA1phyVY2KJsp9q6ldV4GFRSpshKtDZQa5ewr8iI3jL8BQGmLY3qyzzCvSjP-XRbBeYyHTR_SI Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 5a76c0d5639d42c9bb2387d75f4b0f95 Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:35:09.915225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5a76c0d5639d42c9bb2387d75f4b0f95", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 5a76c0d5639d42c9bb2387d75f4b0f95 Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-VolumesSnapshotsTestJSON-275264389-project Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 932c4d9cb0034247905e0bc72b6ccbce Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-VolumesSnapshotsTestJSON-275264389-project Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Snapshot aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 could not be found. Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910'} Jul 18 02:35:09.916420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 could not be found. (HTTP 404) (Request-ID: req-722a7efb-1c62-4157-8246-6187519863af) Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:35:09.917131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:09.918064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 could not be found. Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 02:35:09.922969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 could not be found. Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 could not be found. Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:35:09.924295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-649c2641-5048-49cc-80e4-f9f0295ffe47 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Returning 404 to user: Snapshot aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:09.936098 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-649c2641-5048-49cc-80e4-f9f0295ffe47 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910" status: 404 len: 111 microversion: 2.1 time: 0.079009 Jul 18 02:35:09.937777 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 13/24] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 18 02:35:09 2022] GET /compute/v2.1/os-snapshots/aa4da0ad-4c65-4f53-a4a2-88c1e5bd2910 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:09.956394 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ac146eb3-28a1-460c-a321-27996687f4f1 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0e29af0>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:10.063963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c781f6d6-0229-430e-b0a1-0c7b4aa63e99 tempest-VolumesTestJSON-1430224668 tempest-VolumesTestJSON-1430224668-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.167247 Jul 18 02:35:10.064543 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 12/25] 10.222.0.66 () {58 vars in 1154 bytes} [Mon Jul 18 02:35:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:10.338587 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ac146eb3-28a1-460c-a321-27996687f4f1 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a" status: 202 len: 0 microversion: 2.1 time: 0.394534 Jul 18 02:35:10.340267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 14/26] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 18 02:35:09 2022] DELETE /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:35:10.347810 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1cafea5f-2667-40d5-8b70-6af042ce3b3b tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0487b80>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:10.471084 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1cafea5f-2667-40d5-8b70-6af042ce3b3b tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a" status: 200 len: 344 microversion: 2.1 time: 0.120189 Jul 18 02:35:10.471084 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 13/27] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:10 2022] GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a => generated 344 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:11.478030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0571b56a-33ca-4689-8f89-8982e0e25e06 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0e28af0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:11.563068 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-0571b56a-33ca-4689-8f89-8982e0e25e06 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] HTTP exception thrown: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0571b56a-33ca-4689-8f89-8982e0e25e06 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Request method failure captured: Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a HTTP/1.1 Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbRN6ZiHwf1AhwiKU1-Ijtdop6hddj5Tz-uKkmRaVLifMypBmlorlqawhKbOpLo-LECCtzczPUgf_6pwrbkcDIX6YB1oQPob73hVEA1phyVY2KJsp9q6ldV4GFRSpshKtDZQa5ewr8iI3jL8BQGmLY3qyzzCvSjP-XRbBeYyHTR_SI Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 5a76c0d5639d42c9bb2387d75f4b0f95 Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:35:11.570245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5a76c0d5639d42c9bb2387d75f4b0f95", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 5a76c0d5639d42c9bb2387d75f4b0f95 Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesSnapshotsTestJSON-275264389-project Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 932c4d9cb0034247905e0bc72b6ccbce Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesSnapshotsTestJSON-275264389-project Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '4493d6d0-fc45-408a-8598-22a6a696586a'} Jul 18 02:35:11.586450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. (HTTP 404) (Request-ID: req-b0fea135-7574-4eef-8bdc-f2f2077441d1) Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:11.587208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:11.588287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 02:35:11.589205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.590430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.598214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0571b56a-33ca-4689-8f89-8982e0e25e06 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Returning 404 to user: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:11.599352 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0571b56a-33ca-4689-8f89-8982e0e25e06 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a" status: 404 len: 109 microversion: 2.1 time: 0.125988 Jul 18 02:35:11.605502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 14/28] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:11 2022] GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:11.626230 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2c62cf37-45c6-4b72-beba-831ec3493ef1 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0464af0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:11.713496 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-2c62cf37-45c6-4b72-beba-831ec3493ef1 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] HTTP exception thrown: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2c62cf37-45c6-4b72-beba-831ec3493ef1 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Request method failure captured: Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: DELETE /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a HTTP/1.1 Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbRN6ZiHwf1AhwiKU1-Ijtdop6hddj5Tz-uKkmRaVLifMypBmlorlqawhKbOpLo-LECCtzczPUgf_6pwrbkcDIX6YB1oQPob73hVEA1phyVY2KJsp9q6ldV4GFRSpshKtDZQa5ewr8iI3jL8BQGmLY3qyzzCvSjP-XRbBeYyHTR_SI Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 5a76c0d5639d42c9bb2387d75f4b0f95 Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:35:11.715411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5a76c0d5639d42c9bb2387d75f4b0f95", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 5a76c0d5639d42c9bb2387d75f4b0f95 Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesSnapshotsTestJSON-275264389-project Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 932c4d9cb0034247905e0bc72b6ccbce Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesSnapshotsTestJSON-275264389-project Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '4493d6d0-fc45-408a-8598-22a6a696586a'} Jul 18 02:35:11.716707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. (HTTP 404) (Request-ID: req-cbba0eaf-c17f-4ec6-96d8-38fca0ec2266) Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:11.718035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:35:11.719410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 02:35:11.720633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2c62cf37-45c6-4b72-beba-831ec3493ef1 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Returning 404 to user: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2c62cf37-45c6-4b72-beba-831ec3493ef1 tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a" status: 404 len: 109 microversion: 2.1 time: 0.110446 Jul 18 02:35:11.723104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 15/29] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 18 02:35:11 2022] DELETE /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:11.742496 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-aa660921-36e8-4322-8d9d-fefeaf537bec tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Calling method '.version_select at 0x7f28f0487dc0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:11.833176 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-aa660921-36e8-4322-8d9d-fefeaf537bec tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] HTTP exception thrown: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-aa660921-36e8-4322-8d9d-fefeaf537bec tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Request method failure captured: Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a HTTP/1.1 Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbRN6ZiHwf1AhwiKU1-Ijtdop6hddj5Tz-uKkmRaVLifMypBmlorlqawhKbOpLo-LECCtzczPUgf_6pwrbkcDIX6YB1oQPob73hVEA1phyVY2KJsp9q6ldV4GFRSpshKtDZQa5ewr8iI3jL8BQGmLY3qyzzCvSjP-XRbBeYyHTR_SI Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 5a76c0d5639d42c9bb2387d75f4b0f95 Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:35:11.835883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5a76c0d5639d42c9bb2387d75f4b0f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5a76c0d5639d42c9bb2387d75f4b0f95", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 5a76c0d5639d42c9bb2387d75f4b0f95 Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-275264389 Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesSnapshotsTestJSON-275264389-project Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 932c4d9cb0034247905e0bc72b6ccbce Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesSnapshotsTestJSON-275264389-project Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '4493d6d0-fc45-408a-8598-22a6a696586a'} Jul 18 02:35:11.837069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. (HTTP 404) (Request-ID: req-6f173801-0106-4106-a581-a5d43399bd75) Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:11.837786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:11.838729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 02:35:11.839626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-aa660921-36e8-4322-8d9d-fefeaf537bec tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] Returning 404 to user: Volume 4493d6d0-fc45-408a-8598-22a6a696586a could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-aa660921-36e8-4322-8d9d-fefeaf537bec tempest-VolumesSnapshotsTestJSON-275264389 tempest-VolumesSnapshotsTestJSON-275264389-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a" status: 404 len: 109 microversion: 2.1 time: 0.110506 Jul 18 02:35:11.840538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 16/30] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:11 2022] GET /compute/v2.1/os-volumes/4493d6d0-fc45-408a-8598-22a6a696586a => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:11.902275 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d859844b-e5e7-4c1f-90ac-60884ef13576 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'create', calling method: .version_select at 0x7f28f0444f70>, body: {"keypair": {"name": "tempest-keypair-756383081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL4RrrQcclel9j6PTAzuLCASDZI3iCgpvC5bugmaYzyZilWve6GAKT7DbDkB9SOCBbennaRVtPEwTDHzTe+/Fjh28d4lX5pM5f+FQiOTkjbsUk5Sv9kMd0XTECx7mkm4A=="}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:12.054889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-d859844b-e5e7-4c1f-90ac-60884ef13576 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Getting quotas for project 85204e1ae6844b70b45f8452887d5385. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:12.095658 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-d859844b-e5e7-4c1f-90ac-60884ef13576 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Getting quotas for user 879f7a4cf6664e76bddffc804658b250 and project 85204e1ae6844b70b45f8452887d5385. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:12.197329 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1486201510", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "networks": [{"uuid": "a18092a3-3402-4e73-8d77-80e569fe84ad"}]}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:12.323210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d859844b-e5e7-4c1f-90ac-60884ef13576 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.879917 Jul 18 02:35:12.330841 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 15/31] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 18 02:35:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:12.480103 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] validate_networks() for [('a18092a3-3402-4e73-8d77-80e569fe84ad', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:35:15.501562 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:35:15.502332 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:35:15.502631 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:35:15.503050 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:35:15.503591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:35:15.558601 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:15.571823 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:15.575606 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:15.577213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:15.727038 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Getting quotas for project d0695b3617d845118c00ba7cff6d312a. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:15.762563 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Getting quotas for user 39f6e1501362435d8485ac5eb4b9f315 and project d0695b3617d845118c00ba7cff6d312a. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:15.820442 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:35:15.836690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:35:16.221469 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-330d25ee-404b-4c96-8484-067b16a8729c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.180943 Jul 18 02:35:16.230046 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 17/32] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:35:16.242465 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-caeca49a-dd5b-4952-ae17-975db5bcaf02 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:16.243306 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-caeca49a-dd5b-4952-ae17-975db5bcaf02 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:16.536781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-caeca49a-dd5b-4952-ae17-975db5bcaf02 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:16.566968 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-caeca49a-dd5b-4952-ae17-975db5bcaf02 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1215 microversion: 2.1 time: 0.332632 Jul 18 02:35:16.569518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 16/33] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:16 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1215 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:16.754541 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-78833dc7-c515-4f83-a6a0-74896e8a6b2f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: .version_select at 0x7f28efabe0d0>, body: {"keypair": {"name": "tempest-keypair-1467427019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPu7BVkNWh1izWem5sd/YQLubStddd7ySMQJNPDrTbFp+ttsXei//Mt4tellmLI74qeaPYU/LSPm7eMAuXHcxYGnhuy6Nab8xCZlTjJpuwNRxEk8pj+qQI5wzMGaSkSaA=="}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:16.809156 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-78833dc7-c515-4f83-a6a0-74896e8a6b2f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'key_pairs'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:16.816234 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-78833dc7-c515-4f83-a6a0-74896e8a6b2f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for user 94c16391d39f4498a55c89bf2838788f and project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'key_pairs'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:17.046804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-78833dc7-c515-4f83-a6a0-74896e8a6b2f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.631854 Jul 18 02:35:17.052967 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 18/34] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 18 02:35:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:17.344346 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9811c891-b5bb-4451-af6d-050d15c80adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Action: 'create', calling method: .version_select at 0x7f28efaf3d30>, body: {"keypair": {"name": "tempest-keypair-1922065731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdXxwQJa+anBwxiQ3xSkxp6A8vfm0ceT5I4SQ/FFaTfaDmMsv+amZiHRN+wyXTrvucKGh0i2d9txDdMX6q5v0ssm/tz5gHgD8OERgPoYqQwlqltcjDxgNeDHB54OvXb4A=="}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:17.389458 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-9811c891-b5bb-4451-af6d-050d15c80adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Getting quotas for project f3c1745729fe47238223557221c2e905. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:17.408666 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-9811c891-b5bb-4451-af6d-050d15c80adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Getting quotas for user 7ddb197852db4b20a84aa6c0862468ef and project f3c1745729fe47238223557221c2e905. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:17.580883 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9811c891-b5bb-4451-af6d-050d15c80adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.010045 Jul 18 02:35:17.582068 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 17/35] 10.222.0.66 () {62 vars in 1199 bytes} [Mon Jul 18 02:35:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1012 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:35:17.588062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d68b05ab-a1af-40ca-af24-bc970f335c92 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:17.588580 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d68b05ab-a1af-40ca-af24-bc970f335c92 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:17.959472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d68b05ab-a1af-40ca-af24-bc970f335c92 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:17.986744 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d68b05ab-a1af-40ca-af24-bc970f335c92 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1215 microversion: 2.1 time: 0.402325 Jul 18 02:35:17.990724 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 19/36] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:17 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1215 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:19.007216 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-475c4429-5f6b-43c1-94fc-02cacbeb4463 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:19.008794 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-475c4429-5f6b-43c1-94fc-02cacbeb4463 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:19.162209 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-475c4429-5f6b-43c1-94fc-02cacbeb4463 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:19.173652 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-475c4429-5f6b-43c1-94fc-02cacbeb4463 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1215 microversion: 2.1 time: 0.171283 Jul 18 02:35:19.194997 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 18/37] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:19 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:19.675314 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e11b24cc-24de-4e9e-8503-4ce2d21665d1 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] Action: 'create', calling method: .version_select at 0x7f28f045b160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1295344261", "metadata": {"Type": "work"}}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:20.102295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1666742359", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69054a80-8318-40e4-bbcb-fa67a0902b79"}], "security_groups": [{"name": "tempest-securitygroup--2034601586"}], "key_name": "tempest-keypair-756383081", "user_data": "}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:20.442181 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.network.neutron [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] validate_networks() for [('69054a80-8318-40e4-bbcb-fa67a0902b79', None, None, None, None, None)] {{(pid=124890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:35:20.758177 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e11b24cc-24de-4e9e-8503-4ce2d21665d1 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.727893 Jul 18 02:35:20.759839 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 20/38] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Jul 18 02:35:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1731 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 18 02:35:20.765954 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5ea5c64b-b41e-4dba-b2be-e66b8c0b4b77 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:20.766957 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5ea5c64b-b41e-4dba-b2be-e66b8c0b4b77 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:20.789730 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5ea5c64b-b41e-4dba-b2be-e66b8c0b4b77 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:20.789730 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5ea5c64b-b41e-4dba-b2be-e66b8c0b4b77 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:20.789730 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5ea5c64b-b41e-4dba-b2be-e66b8c0b4b77 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:20.789730 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5ea5c64b-b41e-4dba-b2be-e66b8c0b4b77 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:21.051116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5ea5c64b-b41e-4dba-b2be-e66b8c0b4b77 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:21.092495 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5ea5c64b-b41e-4dba-b2be-e66b8c0b4b77 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1211 microversion: 2.1 time: 0.326643 Jul 18 02:35:21.092495 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 21/39] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:20 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1211 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:21.099992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c4c78c62-c167-4811-88e3-233eece30853 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] Calling method '.version_select at 0x7f28eea08820>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:21.225288 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c4c78c62-c167-4811-88e3-233eece30853 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273" status: 200 len: 353 microversion: 2.1 time: 0.133738 Jul 18 02:35:21.225872 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 22/40] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:21 2022] GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:21.601995 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a83a6b01-2426-483a-873e-db92cd0965ab tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Action: 'create', calling method: .version_select at 0x7f28eea08ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1083595118", "metadata": {"Type": "work"}}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a83a6b01-2426-483a-873e-db92cd0965ab tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Request method failure captured: Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 122 Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MboStc3IPvJ4c-FaJM8ZCq5RoBoH-1-__MThtNqJFfAB_FVszRJiLqv7rYwr82_owGHHjeq3A9942x3uSPo9mUoEmPtCkhxyJYWnbbEo2UrWiuzie7zJCX2bvMqpqnVbPRH7ou1G39nHsHy0kGMQmhHdI4CZLS1sSUKLbII2iyhFvU Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:35:21.624342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77733b7b070540db93d486df83e565f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77733b7b070540db93d486df83e565f1", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: abcb0a70133544c693cf846812198893 Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1083595118", "metadata": {"Type": "work"}}} Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: Jul 18 02:35:21.625581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1083595118', 'metadata': {'Type': 'work'}}}} Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:21.626544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:35:21.627716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:35:21.628749 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 02:35:21.628749 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.628749 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a83a6b01-2426-483a-873e-db92cd0965ab tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:21.630398 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a83a6b01-2426-483a-873e-db92cd0965ab tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.399078 Jul 18 02:35:21.631097 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 23/41] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Jul 18 02:35:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 405 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:35:21.658245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0bdbdd9c-385d-4e68-8ab7-b1f728dc7a11 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Action: 'create', calling method: .version_select at 0x7f28eea08160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1917799261", "metadata": {"Type": "work"}}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0bdbdd9c-385d-4e68-8ab7-b1f728dc7a11 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Request method failure captured: Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 120 Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MboStc3IPvJ4c-FaJM8ZCq5RoBoH-1-__MThtNqJFfAB_FVszRJiLqv7rYwr82_owGHHjeq3A9942x3uSPo9mUoEmPtCkhxyJYWnbbEo2UrWiuzie7zJCX2bvMqpqnVbPRH7ou1G39nHsHy0kGMQmhHdI4CZLS1sSUKLbII2iyhFvU Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:35:21.665864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77733b7b070540db93d486df83e565f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77733b7b070540db93d486df83e565f1", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: abcb0a70133544c693cf846812198893 Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1917799261", "metadata": {"Type": "work"}}} Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: Jul 18 02:35:21.667075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1917799261', 'metadata': {'Type': 'work'}}}} Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi '0' Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:21.667780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:35:21.668843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:35:21.670471 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 02:35:21.670471 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.670471 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0bdbdd9c-385d-4e68-8ab7-b1f728dc7a11 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:21.670777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0bdbdd9c-385d-4e68-8ab7-b1f728dc7a11 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029283 Jul 18 02:35:21.672506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 24/42] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Jul 18 02:35:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:35:21.683344 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ff48c62d-58b3-4fd6-9d92-b9d635837183 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Action: 'create', calling method: .version_select at 0x7f28eea29670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-201071122", "metadata": {"Type": "work"}}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ff48c62d-58b3-4fd6-9d92-b9d635837183 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Request method failure captured: Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 118 Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MboStc3IPvJ4c-FaJM8ZCq5RoBoH-1-__MThtNqJFfAB_FVszRJiLqv7rYwr82_owGHHjeq3A9942x3uSPo9mUoEmPtCkhxyJYWnbbEo2UrWiuzie7zJCX2bvMqpqnVbPRH7ou1G39nHsHy0kGMQmhHdI4CZLS1sSUKLbII2iyhFvU Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:35:21.691649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77733b7b070540db93d486df83e565f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77733b7b070540db93d486df83e565f1", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: abcb0a70133544c693cf846812198893 Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-201071122", "metadata": {"Type": "work"}}} Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: Jul 18 02:35:21.692953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-201071122', 'metadata': {'Type': 'work'}}}} Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise error Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi '' Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:21.693748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 02:35:21.695976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 02:35:21.698493 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 02:35:21.698493 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.699836 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ff48c62d-58b3-4fd6-9d92-b9d635837183 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:21.701403 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ff48c62d-58b3-4fd6-9d92-b9d635837183 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024006 Jul 18 02:35:21.702733 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 25/43] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Jul 18 02:35:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:35:21.722827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4bd20012-de68-4d18-9d06-311ba9ad5748 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Calling method '.version_select at 0x7f28eea08430>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:21.795761 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-4bd20012-de68-4d18-9d06-311ba9ad5748 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] HTTP exception thrown: Volume tempest-invalid-1724802119 could not be found. Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4bd20012-de68-4d18-9d06-311ba9ad5748 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Request method failure captured: Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1724802119 HTTP/1.1 Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MboStc3IPvJ4c-FaJM8ZCq5RoBoH-1-__MThtNqJFfAB_FVszRJiLqv7rYwr82_owGHHjeq3A9942x3uSPo9mUoEmPtCkhxyJYWnbbEo2UrWiuzie7zJCX2bvMqpqnVbPRH7ou1G39nHsHy0kGMQmhHdI4CZLS1sSUKLbII2iyhFvU Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:35:21.804940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77733b7b070540db93d486df83e565f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77733b7b070540db93d486df83e565f1", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: abcb0a70133544c693cf846812198893 Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Volume tempest-invalid-1724802119 could not be found. Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': 'tempest-invalid-1724802119'} Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:21.806461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1724802119 could not be found. (HTTP 404) (Request-ID: req-0c368917-130c-4a5c-9445-fa2b694a260f) Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.807208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:35:21.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1724802119 could not be found. Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:21.810132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1724802119 could not be found. Jul 18 02:35:21.812970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.812970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.812970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.812970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.812970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.812970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.812970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:21.812970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:21.812970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1724802119 could not be found. Jul 18 02:35:21.812970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.817180 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4bd20012-de68-4d18-9d06-311ba9ad5748 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Returning 404 to user: Volume tempest-invalid-1724802119 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:21.817180 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4bd20012-de68-4d18-9d06-311ba9ad5748 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1724802119" status: 404 len: 99 microversion: 2.1 time: 0.105423 Jul 18 02:35:21.817639 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 26/44] 10.222.0.66 () {58 vars in 1217 bytes} [Mon Jul 18 02:35:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1724802119 => generated 99 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:35:21.827622 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-679c883d-61fa-4dec-af0d-137b79e6f384 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005291 Jul 18 02:35:21.828148 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 27/45] 10.222.0.66 () {58 vars in 1139 bytes} [Mon Jul 18 02:35:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:35:21.844937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b08a942a-cc23-4880-b9f6-34202356f0b3 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006495 Jul 18 02:35:21.846998 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 28/46] 10.222.0.66 () {58 vars in 1136 bytes} [Mon Jul 18 02:35:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 02:35:21.861598 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-762f356b-4a5c-44d9-830f-2bb214f9a2f5 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Calling method '.version_select at 0x7f28eea08670>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:21.894867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-762f356b-4a5c-44d9-830f-2bb214f9a2f5 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] HTTP exception thrown: Volume ba56ee60-35fb-48a3-9bc6-5f295b17cb82 could not be found. Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-762f356b-4a5c-44d9-830f-2bb214f9a2f5 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Request method failure captured: Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: DELETE /compute/v2.1/os-volumes/ba56ee60-35fb-48a3-9bc6-5f295b17cb82 HTTP/1.1 Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MboStc3IPvJ4c-FaJM8ZCq5RoBoH-1-__MThtNqJFfAB_FVszRJiLqv7rYwr82_owGHHjeq3A9942x3uSPo9mUoEmPtCkhxyJYWnbbEo2UrWiuzie7zJCX2bvMqpqnVbPRH7ou1G39nHsHy0kGMQmhHdI4CZLS1sSUKLbII2iyhFvU Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:35:21.897145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77733b7b070540db93d486df83e565f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77733b7b070540db93d486df83e565f1", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: abcb0a70133544c693cf846812198893 Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Volume ba56ee60-35fb-48a3-9bc6-5f295b17cb82 could not be found. Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': 'ba56ee60-35fb-48a3-9bc6-5f295b17cb82'} Jul 18 02:35:21.898271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba56ee60-35fb-48a3-9bc6-5f295b17cb82 could not be found. (HTTP 404) (Request-ID: req-31c07908-c5a6-4194-979a-e4c85f2c4be4) Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.898950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 02:35:21.899912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba56ee60-35fb-48a3-9bc6-5f295b17cb82 could not be found. Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 02:35:21.900942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba56ee60-35fb-48a3-9bc6-5f295b17cb82 could not be found. Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba56ee60-35fb-48a3-9bc6-5f295b17cb82 could not be found. Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-762f356b-4a5c-44d9-830f-2bb214f9a2f5 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Returning 404 to user: Volume ba56ee60-35fb-48a3-9bc6-5f295b17cb82 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-762f356b-4a5c-44d9-830f-2bb214f9a2f5 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/ba56ee60-35fb-48a3-9bc6-5f295b17cb82" status: 404 len: 109 microversion: 2.1 time: 0.045873 Jul 18 02:35:21.902800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 29/47] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 18 02:35:21 2022] DELETE /compute/v2.1/os-volumes/ba56ee60-35fb-48a3-9bc6-5f295b17cb82 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:21.909926 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b1dfb523-6229-463d-a143-599203252313 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Calling method '.version_select at 0x7f28eea12700>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:21.943354 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-b1dfb523-6229-463d-a143-599203252313 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] HTTP exception thrown: Volume e188049e-752a-47fb-84ce-f1671361abdd could not be found. Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b1dfb523-6229-463d-a143-599203252313 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Request method failure captured: Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/os-volumes/e188049e-752a-47fb-84ce-f1671361abdd HTTP/1.1 Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MboStc3IPvJ4c-FaJM8ZCq5RoBoH-1-__MThtNqJFfAB_FVszRJiLqv7rYwr82_owGHHjeq3A9942x3uSPo9mUoEmPtCkhxyJYWnbbEo2UrWiuzie7zJCX2bvMqpqnVbPRH7ou1G39nHsHy0kGMQmhHdI4CZLS1sSUKLbII2iyhFvU Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:35:21.949385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/77733b7b070540db93d486df83e565f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/77733b7b070540db93d486df83e565f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_77733b7b070540db93d486df83e565f1", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 77733b7b070540db93d486df83e565f1 Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesNegativeTest-98578933 Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: abcb0a70133544c693cf846812198893 Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesNegativeTest-98578933-project Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Volume e188049e-752a-47fb-84ce-f1671361abdd could not be found. Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': 'e188049e-752a-47fb-84ce-f1671361abdd'} Jul 18 02:35:21.950809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e188049e-752a-47fb-84ce-f1671361abdd could not be found. (HTTP 404) (Request-ID: req-67165c29-b486-4361-af8c-d847a68ccef9) Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.953517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:21.954517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e188049e-752a-47fb-84ce-f1671361abdd could not be found. Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 02:35:21.956770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e188049e-752a-47fb-84ce-f1671361abdd could not be found. Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e188049e-752a-47fb-84ce-f1671361abdd could not be found. Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b1dfb523-6229-463d-a143-599203252313 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] Returning 404 to user: Volume e188049e-752a-47fb-84ce-f1671361abdd could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b1dfb523-6229-463d-a143-599203252313 tempest-VolumesNegativeTest-98578933 tempest-VolumesNegativeTest-98578933-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e188049e-752a-47fb-84ce-f1671361abdd" status: 404 len: 109 microversion: 2.1 time: 0.042282 Jul 18 02:35:21.958989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 30/48] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:21 2022] GET /compute/v2.1/os-volumes/e188049e-752a-47fb-84ce-f1671361abdd => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:35:22.109858 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-60e72499-59ec-43f4-9595-54dc65676ca8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:22.109858 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-60e72499-59ec-43f4-9595-54dc65676ca8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:22.116257 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-60e72499-59ec-43f4-9595-54dc65676ca8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.117118 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-60e72499-59ec-43f4-9595-54dc65676ca8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:22.118160 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-60e72499-59ec-43f4-9595-54dc65676ca8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.118830 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-60e72499-59ec-43f4-9595-54dc65676ca8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:22.214122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-60e72499-59ec-43f4-9595-54dc65676ca8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:22.223601 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-60e72499-59ec-43f4-9595-54dc65676ca8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1285 microversion: 2.1 time: 0.121261 Jul 18 02:35:22.224532 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 31/49] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:22 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:22.239399 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5a04e45a-c6fa-4a83-9e36-8b1ac24dfc42 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] Calling method '.version_select at 0x7f28ee9c0dc0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:22.333370 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5a04e45a-c6fa-4a83-9e36-8b1ac24dfc42 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273" status: 200 len: 354 microversion: 2.1 time: 0.097599 Jul 18 02:35:22.333944 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 32/50] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:22 2022] GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:22.354506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9b45a48b-c727-49dc-bd50-86c7a963194e tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] Calling method '.version_select at 0x7f28ee97f5e0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:22.509409 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9b45a48b-c727-49dc-bd50-86c7a963194e tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273" status: 200 len: 354 microversion: 2.1 time: 0.158641 Jul 18 02:35:22.510065 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 33/51] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:22 2022] GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273 => generated 354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:22.532386 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-95b72229-88c7-40e4-ad40-77605bd1e5e2 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] Calling method '.version_select at 0x7f28ee97fd30>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:22.643632 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Flavor limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:35:22.645357 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Image limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:35:22.646730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Flavor pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:35:22.649947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Image pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:35:22.650762 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:35:22.666236 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.667470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:22.668639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:22.670373 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:22.719493 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Getting quotas for project 85204e1ae6844b70b45f8452887d5385. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:22.724722 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Getting quotas for user 879f7a4cf6664e76bddffc804658b250 and project 85204e1ae6844b70b45f8452887d5385. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:22.740849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Going to run 1 instances... {{(pid=124890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:35:22.744719 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:35:22.910499 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-95b72229-88c7-40e4-ad40-77605bd1e5e2 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273" status: 202 len: 0 microversion: 2.1 time: 0.383772 Jul 18 02:35:22.916812 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 34/52] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 18 02:35:22 2022] DELETE /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:35:22.919341 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4b7f1079-6db4-4915-8d5a-3342fb77e2c4 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] Calling method '.version_select at 0x7f28ee97f4c0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:23.029936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-22947d71-8e1e-46eb-9da7-d27155ffa3e7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.938000 Jul 18 02:35:23.033446 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 19/53] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:35:23.047752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-311bc447-ec69-4b12-88c0-3303b9914026 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:23.054953 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-311bc447-ec69-4b12-88c0-3303b9914026 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:23.103574 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4b7f1079-6db4-4915-8d5a-3342fb77e2c4 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273" status: 200 len: 353 microversion: 2.1 time: 0.188300 Jul 18 02:35:23.104159 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 35/54] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:22 2022] GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273 => generated 353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:23.286188 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-311bc447-ec69-4b12-88c0-3303b9914026 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:23.286845 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4857e3b5-029c-49c1-8541-5b5a28d1cd67 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:23.286845 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4857e3b5-029c-49c1-8541-5b5a28d1cd67 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:23.287157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-311bc447-ec69-4b12-88c0-3303b9914026 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1237 microversion: 2.1 time: 0.241528 Jul 18 02:35:23.287157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 20/55] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:23 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1237 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:23.298589 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4857e3b5-029c-49c1-8541-5b5a28d1cd67 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:23.301414 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4857e3b5-029c-49c1-8541-5b5a28d1cd67 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:23.303570 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4857e3b5-029c-49c1-8541-5b5a28d1cd67 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:23.309378 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4857e3b5-029c-49c1-8541-5b5a28d1cd67 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:23.673091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4857e3b5-029c-49c1-8541-5b5a28d1cd67 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:23.696908 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4857e3b5-029c-49c1-8541-5b5a28d1cd67 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1273 microversion: 2.1 time: 0.455829 Jul 18 02:35:23.710120 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 36/56] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:23 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1273 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:23.877466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-787604589", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdc6ffcf-95a1-4f66-b96c-1c077c87b2a3"}], "security_groups": [{"name": "tempest-securitygroup--1136765090"}], "key_name": "tempest-keypair-1467427019", "user_data": "}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:24.116165 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0163a677-4cea-4fc7-b1ac-fd22fdb783a2 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] Calling method '.version_select at 0x7f28ee97f3a0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:24.184519 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-0163a677-4cea-4fc7-b1ac-fd22fdb783a2 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] HTTP exception thrown: Volume 7b4fa88a-6391-494e-b556-cf1463604273 could not be found. Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0163a677-4cea-4fc7-b1ac-fd22fdb783a2 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] Request method failure captured: Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273 HTTP/1.1 Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbmC86NEWMPkdvxsljmtI465Ra5iZbITNXFTf6dXX08BzQeVzwt7neaTEM4Qr55R0sUz10em7FZNvmyppkx_jGVapqf7tf5dIann3LUctfPjuZAeQYfkG3zU6uTFs0vJW_cepUyhpieo5_pWl7q23yCmeaPHLlTCOWKvQn3EgHBhzc Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 111367517d7f4746b244db54a7af290a Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesGetTestJSON-2087290543 Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:35:24.188327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/111367517d7f4746b244db54a7af290a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/111367517d7f4746b244db54a7af290a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/111367517d7f4746b244db54a7af290a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_111367517d7f4746b244db54a7af290a", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesGetTestJSON-2087290543 Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 111367517d7f4746b244db54a7af290a Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesGetTestJSON-2087290543 Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesGetTestJSON-2087290543-project Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 92b24ef8f7f44c87a55d1410d3cb07d4 Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesGetTestJSON-2087290543-project Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Volume 7b4fa88a-6391-494e-b556-cf1463604273 could not be found. Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '7b4fa88a-6391-494e-b556-cf1463604273'} Jul 18 02:35:24.190554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b4fa88a-6391-494e-b556-cf1463604273 could not be found. (HTTP 404) (Request-ID: req-fc257457-a733-4f1f-88c6-a5eba6502493) Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:24.191367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 02:35:24.192460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b4fa88a-6391-494e-b556-cf1463604273 could not be found. Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 02:35:24.197404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b4fa88a-6391-494e-b556-cf1463604273 could not be found. Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b4fa88a-6391-494e-b556-cf1463604273 could not be found. Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0163a677-4cea-4fc7-b1ac-fd22fdb783a2 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] Returning 404 to user: Volume 7b4fa88a-6391-494e-b556-cf1463604273 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0163a677-4cea-4fc7-b1ac-fd22fdb783a2 tempest-VolumesGetTestJSON-2087290543 tempest-VolumesGetTestJSON-2087290543-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273" status: 404 len: 109 microversion: 2.1 time: 0.079293 Jul 18 02:35:24.199865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 37/57] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Jul 18 02:35:24 2022] GET /compute/v2.1/os-volumes/7b4fa88a-6391-494e-b556-cf1463604273 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:35:24.257013 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1147003103", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf656dc8-ef6c-43a1-bbd8-140e60e69fc7"}], "security_groups": [{"name": "tempest-securitygroup--660185386"}], "key_name": "tempest-keypair-1922065731", "user_data": "}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:24.508940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] validate_networks() for [('cf656dc8-ef6c-43a1-bbd8-140e60e69fc7', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:35:24.597851 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.network.neutron [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] validate_networks() for [('cdc6ffcf-95a1-4f66-b96c-1c077c87b2a3', None, None, None, None, None)] {{(pid=124890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:35:25.650772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:25.693115 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:35:25.693560 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:35:25.694063 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:35:25.694560 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:35:25.695046 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:35:25.712271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:25.712271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:25.712271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:25.712271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:25.741540 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Getting quotas for project f3c1745729fe47238223557221c2e905. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:25.745827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Getting quotas for user 7ddb197852db4b20a84aa6c0862468ef and project f3c1745729fe47238223557221c2e905. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:25.766872 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:35:25.774343 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:35:25.807174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Flavor limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:35:25.807708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Image limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:35:25.808225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Flavor pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:35:25.808989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Image pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:35:25.809393 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:35:25.832132 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:25.832132 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:25.832132 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:25.832132 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:25.888743 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:35:25.895040 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for user 94c16391d39f4498a55c89bf2838788f and project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:35:25.920955 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Going to run 1 instances... {{(pid=124890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:35:25.924933 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:35:25.990259 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a2c5cce9-025a-4e44-84e3-035e38a437c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.738002 Jul 18 02:35:25.992912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 38/58] 10.222.0.66 () {62 vars in 1187 bytes} [Mon Jul 18 02:35:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:35:26.007402 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-850dbc9d-f0dc-4ea8-9135-7f9a84418b50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:26.009395 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-850dbc9d-f0dc-4ea8-9135-7f9a84418b50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:26.041501 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-850dbc9d-f0dc-4ea8-9135-7f9a84418b50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:26.046061 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-850dbc9d-f0dc-4ea8-9135-7f9a84418b50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:26.067312 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-850dbc9d-f0dc-4ea8-9135-7f9a84418b50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:26.070143 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-850dbc9d-f0dc-4ea8-9135-7f9a84418b50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:26.167795 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3ab1b9c9-8a72-40d8-aa30-fc5abebf2d79 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.325126 Jul 18 02:35:26.167795 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 21/59] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:35:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:35:26.196296 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1ec37e11-ddfc-4bf8-aa44-eea396f3fac1 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:26.196296 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1ec37e11-ddfc-4bf8-aa44-eea396f3fac1 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:26.244147 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1ec37e11-ddfc-4bf8-aa44-eea396f3fac1 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:26.245531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1ec37e11-ddfc-4bf8-aa44-eea396f3fac1 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:26.246884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1ec37e11-ddfc-4bf8-aa44-eea396f3fac1 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:26.248662 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1ec37e11-ddfc-4bf8-aa44-eea396f3fac1 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:26.460993 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-850dbc9d-f0dc-4ea8-9135-7f9a84418b50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:26.473492 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-850dbc9d-f0dc-4ea8-9135-7f9a84418b50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1241 microversion: 2.1 time: 0.479277 Jul 18 02:35:26.486154 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 39/60] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:25 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1241 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:26.533151 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8cdca43b-50fd-48ba-9616-5d4939ea4be7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:26.534019 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8cdca43b-50fd-48ba-9616-5d4939ea4be7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:26.735437 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8cdca43b-50fd-48ba-9616-5d4939ea4be7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:26.750506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8cdca43b-50fd-48ba-9616-5d4939ea4be7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:26.757493 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8cdca43b-50fd-48ba-9616-5d4939ea4be7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:26.767807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8cdca43b-50fd-48ba-9616-5d4939ea4be7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1282 microversion: 2.20 time: 0.277259 Jul 18 02:35:26.784244 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 40/61] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:26 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1282 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:26.791468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d351520d-2886-433c-81e2-ba05dee0b204 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:26.792092 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d351520d-2886-433c-81e2-ba05dee0b204 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:26.880620 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d351520d-2886-433c-81e2-ba05dee0b204 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:26.889962 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d351520d-2886-433c-81e2-ba05dee0b204 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1241 microversion: 2.1 time: 0.102402 Jul 18 02:35:26.890660 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 41/62] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:26 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:27.488045 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1ec37e11-ddfc-4bf8-aa44-eea396f3fac1 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:27.499751 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2926f196-71c9-4ae1-a4e7-2d8250c5f144 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:27.500571 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2926f196-71c9-4ae1-a4e7-2d8250c5f144 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:27.509543 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1ec37e11-ddfc-4bf8-aa44-eea396f3fac1 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 1.335274 Jul 18 02:35:27.515158 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 22/63] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:26 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:27.556618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2926f196-71c9-4ae1-a4e7-2d8250c5f144 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:27.556618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2926f196-71c9-4ae1-a4e7-2d8250c5f144 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:27.556618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2926f196-71c9-4ae1-a4e7-2d8250c5f144 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:27.556618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2926f196-71c9-4ae1-a4e7-2d8250c5f144 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:27.675484 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-2926f196-71c9-4ae1-a4e7-2d8250c5f144 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:27.689828 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2926f196-71c9-4ae1-a4e7-2d8250c5f144 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1233 microversion: 2.1 time: 0.196512 Jul 18 02:35:27.691411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 42/64] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:27 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1233 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:27.796489 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e0b5f75f-b0cf-436f-a22c-e384fa74efa4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:27.797094 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e0b5f75f-b0cf-436f-a22c-e384fa74efa4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:27.908882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8e113d52-86c5-432f-9f39-d8c41a97ef01 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:27.911195 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8e113d52-86c5-432f-9f39-d8c41a97ef01 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:28.111491 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8e113d52-86c5-432f-9f39-d8c41a97ef01 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.119254 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8e113d52-86c5-432f-9f39-d8c41a97ef01 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1241 microversion: 2.1 time: 0.214066 Jul 18 02:35:28.130172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 43/65] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:27 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:28.131502 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e0b5f75f-b0cf-436f-a22c-e384fa74efa4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.132260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e0b5f75f-b0cf-436f-a22c-e384fa74efa4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.133909 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e0b5f75f-b0cf-436f-a22c-e384fa74efa4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.135139 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e0b5f75f-b0cf-436f-a22c-e384fa74efa4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1282 microversion: 2.20 time: 0.348270 Jul 18 02:35:28.142909 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 23/66] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:27 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1282 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:28.533686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8bbd0d67-8e56-44a5-82a9-66b9f627b72e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:28.534534 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8bbd0d67-8e56-44a5-82a9-66b9f627b72e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:28.549862 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8bbd0d67-8e56-44a5-82a9-66b9f627b72e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.554362 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8bbd0d67-8e56-44a5-82a9-66b9f627b72e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.555637 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8bbd0d67-8e56-44a5-82a9-66b9f627b72e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.556410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8bbd0d67-8e56-44a5-82a9-66b9f627b72e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.709392 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-eed436d9-57de-4c92-ab08-333e7549c65d tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:28.710276 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-eed436d9-57de-4c92-ab08-333e7549c65d tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:28.729407 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eed436d9-57de-4c92-ab08-333e7549c65d tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.731147 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eed436d9-57de-4c92-ab08-333e7549c65d tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.739782 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eed436d9-57de-4c92-ab08-333e7549c65d tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:28.740961 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eed436d9-57de-4c92-ab08-333e7549c65d tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:28.970925 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-eed436d9-57de-4c92-ab08-333e7549c65d tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:28.979765 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-eed436d9-57de-4c92-ab08-333e7549c65d tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1289 microversion: 2.1 time: 0.275177 Jul 18 02:35:28.994516 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 24/67] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:28 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1289 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:29.023029 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8bbd0d67-8e56-44a5-82a9-66b9f627b72e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:29.032677 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8bbd0d67-8e56-44a5-82a9-66b9f627b72e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.503664 Jul 18 02:35:29.042992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 44/68] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:28 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:29.137855 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b1cd2a2e-1f88-4a8d-a3c4-6dcdd8af2baf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:29.142349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b1cd2a2e-1f88-4a8d-a3c4-6dcdd8af2baf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:29.162412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b1cd2a2e-1f88-4a8d-a3c4-6dcdd8af2baf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.167232 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b1cd2a2e-1f88-4a8d-a3c4-6dcdd8af2baf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.167232 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b1cd2a2e-1f88-4a8d-a3c4-6dcdd8af2baf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.167232 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b1cd2a2e-1f88-4a8d-a3c4-6dcdd8af2baf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.172189 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1a6e8e64-38bf-486d-badd-c48f80ff2970 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:29.174305 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1a6e8e64-38bf-486d-badd-c48f80ff2970 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:29.198686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a6e8e64-38bf-486d-badd-c48f80ff2970 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.207495 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a6e8e64-38bf-486d-badd-c48f80ff2970 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.207495 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a6e8e64-38bf-486d-badd-c48f80ff2970 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:29.210478 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a6e8e64-38bf-486d-badd-c48f80ff2970 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:29.375424 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b1cd2a2e-1f88-4a8d-a3c4-6dcdd8af2baf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:29.386844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b1cd2a2e-1f88-4a8d-a3c4-6dcdd8af2baf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1245 microversion: 2.1 time: 0.253589 Jul 18 02:35:29.422591 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 25/69] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:29 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1245 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:29.482847 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1a6e8e64-38bf-486d-badd-c48f80ff2970 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:29.504840 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1a6e8e64-38bf-486d-badd-c48f80ff2970 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:29.511314 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1a6e8e64-38bf-486d-badd-c48f80ff2970 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:29.514408 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1a6e8e64-38bf-486d-badd-c48f80ff2970 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1286 microversion: 2.20 time: 0.356568 Jul 18 02:35:29.516251 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 45/70] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:29 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1286 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:29.998376 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2bee6fcd-2f28-492b-9ed3-a9796af3b2e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:30.001011 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2bee6fcd-2f28-492b-9ed3-a9796af3b2e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:30.033793 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bee6fcd-2f28-492b-9ed3-a9796af3b2e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.034952 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bee6fcd-2f28-492b-9ed3-a9796af3b2e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.037756 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bee6fcd-2f28-492b-9ed3-a9796af3b2e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.050883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9e1d3cc6-eeb1-4f93-b36c-a44b0bc7cfdd tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:30.052157 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9e1d3cc6-eeb1-4f93-b36c-a44b0bc7cfdd tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:30.055578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bee6fcd-2f28-492b-9ed3-a9796af3b2e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.063331 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9e1d3cc6-eeb1-4f93-b36c-a44b0bc7cfdd tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.085236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9e1d3cc6-eeb1-4f93-b36c-a44b0bc7cfdd tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.086125 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9e1d3cc6-eeb1-4f93-b36c-a44b0bc7cfdd tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.086574 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9e1d3cc6-eeb1-4f93-b36c-a44b0bc7cfdd tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.295765 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2bee6fcd-2f28-492b-9ed3-a9796af3b2e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:30.311783 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2bee6fcd-2f28-492b-9ed3-a9796af3b2e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1295 microversion: 2.1 time: 0.317765 Jul 18 02:35:30.319434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 26/71] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:29 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1295 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:30.434926 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-9e1d3cc6-eeb1-4f93-b36c-a44b0bc7cfdd tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:30.449377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9e1d3cc6-eeb1-4f93-b36c-a44b0bc7cfdd tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.402771 Jul 18 02:35:30.460963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 46/72] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:30 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:30.466432 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cfa38f98-ff33-4734-a47d-19d5a5256825 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:30.467058 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-cfa38f98-ff33-4734-a47d-19d5a5256825 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:30.518852 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cfa38f98-ff33-4734-a47d-19d5a5256825 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.518852 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cfa38f98-ff33-4734-a47d-19d5a5256825 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.518852 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cfa38f98-ff33-4734-a47d-19d5a5256825 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.529143 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cfa38f98-ff33-4734-a47d-19d5a5256825 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.775433 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-98f9d272-9507-410d-ba5f-457da1052e16 req-5860985d-eb99-4a1a-b38a-4dfccd1d8801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0900bee1-a6cb-431f-9596-b1f13f8e8762", "tag": "b96e2133-e507-43d3-98e8-30f0e0715209"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:30.810911 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-98f9d272-9507-410d-ba5f-457da1052e16 req-5860985d-eb99-4a1a-b38a-4dfccd1d8801 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.811223 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-98f9d272-9507-410d-ba5f-457da1052e16 req-5860985d-eb99-4a1a-b38a-4dfccd1d8801 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.825455 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-cfa38f98-ff33-4734-a47d-19d5a5256825 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:30.845963 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-98f9d272-9507-410d-ba5f-457da1052e16 req-5860985d-eb99-4a1a-b38a-4dfccd1d8801 service nova] Creating event network-changed:b96e2133-e507-43d3-98e8-30f0e0715209 for instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 on hv-cinder-85001 Jul 18 02:35:30.846482 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-98f9d272-9507-410d-ba5f-457da1052e16 req-5860985d-eb99-4a1a-b38a-4dfccd1d8801 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:35:30.847622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2191da7d-6589-4a8f-8a7c-5c4e7de0cf3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.848065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2191da7d-6589-4a8f-8a7c-5c4e7de0cf3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.848856 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2191da7d-6589-4a8f-8a7c-5c4e7de0cf3e None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.849292 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2191da7d-6589-4a8f-8a7c-5c4e7de0cf3e None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.865966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-cfa38f98-ff33-4734-a47d-19d5a5256825 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1293 microversion: 2.1 time: 0.393600 Jul 18 02:35:30.870898 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 47/73] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:30 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1293 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:30.887952 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-46c3c0d2-bb27-4deb-a38b-eaff5f54d308 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:30.890206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-46c3c0d2-bb27-4deb-a38b-eaff5f54d308 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:30.903053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46c3c0d2-bb27-4deb-a38b-eaff5f54d308 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.904963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46c3c0d2-bb27-4deb-a38b-eaff5f54d308 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.912187 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46c3c0d2-bb27-4deb-a38b-eaff5f54d308 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:30.913114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46c3c0d2-bb27-4deb-a38b-eaff5f54d308 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:30.916008 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.compute.rpcapi [None req-2191da7d-6589-4a8f-8a7c-5c4e7de0cf3e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 02:35:30.916940 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2191da7d-6589-4a8f-8a7c-5c4e7de0cf3e None None] Releasing lock "compute-rpcapi-router" {{(pid=124890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:35:30.969235 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2191da7d-6589-4a8f-8a7c-5c4e7de0cf3e None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.592625 Jul 18 02:35:30.970937 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 27/74] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:31.078472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-46c3c0d2-bb27-4deb-a38b-eaff5f54d308 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:31.116978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-46c3c0d2-bb27-4deb-a38b-eaff5f54d308 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:31.119718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-46c3c0d2-bb27-4deb-a38b-eaff5f54d308 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:31.123306 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-46c3c0d2-bb27-4deb-a38b-eaff5f54d308 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1334 microversion: 2.20 time: 0.250583 Jul 18 02:35:31.127114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 48/75] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:30 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1334 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:31.347392 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a1a30e1b-efe4-468a-87c5-40a53a9bbb9b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:31.348973 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a1a30e1b-efe4-468a-87c5-40a53a9bbb9b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:31.365595 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a1a30e1b-efe4-468a-87c5-40a53a9bbb9b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.366466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a1a30e1b-efe4-468a-87c5-40a53a9bbb9b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.370524 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a1a30e1b-efe4-468a-87c5-40a53a9bbb9b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.372601 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a1a30e1b-efe4-468a-87c5-40a53a9bbb9b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.476627 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-178f1346-f10b-4eed-96a3-fa434f4fc70a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:31.477757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-178f1346-f10b-4eed-96a3-fa434f4fc70a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:31.505379 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-178f1346-f10b-4eed-96a3-fa434f4fc70a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.508568 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-178f1346-f10b-4eed-96a3-fa434f4fc70a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.510965 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-178f1346-f10b-4eed-96a3-fa434f4fc70a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.514238 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-178f1346-f10b-4eed-96a3-fa434f4fc70a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.697098 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a1a30e1b-efe4-468a-87c5-40a53a9bbb9b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:31.709130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a1a30e1b-efe4-468a-87c5-40a53a9bbb9b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1295 microversion: 2.1 time: 0.375954 Jul 18 02:35:31.717327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 28/76] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:31 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1295 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:31.863288 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-178f1346-f10b-4eed-96a3-fa434f4fc70a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:31.875720 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-178f1346-f10b-4eed-96a3-fa434f4fc70a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.404197 Jul 18 02:35:31.878369 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 49/77] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:31 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:31.892871 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-22f09ab8-bf12-4494-ab32-d3228c0e3aed tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:31.893528 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-22f09ab8-bf12-4494-ab32-d3228c0e3aed tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:31.921175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-22f09ab8-bf12-4494-ab32-d3228c0e3aed tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.924563 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-22f09ab8-bf12-4494-ab32-d3228c0e3aed tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:31.929601 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-22f09ab8-bf12-4494-ab32-d3228c0e3aed tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:31.941738 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-22f09ab8-bf12-4494-ab32-d3228c0e3aed tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.203781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-22f09ab8-bf12-4494-ab32-d3228c0e3aed tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:32.205992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ab21259a-eaea-442e-881a-dbd1189425bc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:32.205992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ab21259a-eaea-442e-881a-dbd1189425bc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:32.206816 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-22f09ab8-bf12-4494-ab32-d3228c0e3aed tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1301 microversion: 2.1 time: 0.265431 Jul 18 02:35:32.206816 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 29/78] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:31 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1301 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:32.207273 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab21259a-eaea-442e-881a-dbd1189425bc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.207273 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab21259a-eaea-442e-881a-dbd1189425bc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.207273 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab21259a-eaea-442e-881a-dbd1189425bc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.207273 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab21259a-eaea-442e-881a-dbd1189425bc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.353059 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ab21259a-eaea-442e-881a-dbd1189425bc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:32.375621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ab21259a-eaea-442e-881a-dbd1189425bc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:32.382912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ab21259a-eaea-442e-881a-dbd1189425bc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:32.382912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ab21259a-eaea-442e-881a-dbd1189425bc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1342 microversion: 2.20 time: 0.239851 Jul 18 02:35:32.382912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 50/79] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:32 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:32.738395 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c76b78c1-3ad1-41dd-bf3b-dd7437eb6be4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:32.739721 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c76b78c1-3ad1-41dd-bf3b-dd7437eb6be4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:32.757616 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c76b78c1-3ad1-41dd-bf3b-dd7437eb6be4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.757616 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c76b78c1-3ad1-41dd-bf3b-dd7437eb6be4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.759886 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c76b78c1-3ad1-41dd-bf3b-dd7437eb6be4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.761310 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c76b78c1-3ad1-41dd-bf3b-dd7437eb6be4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.893278 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-37424980-f7f8-49d6-9a33-0d33da9b5644 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:32.894209 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-37424980-f7f8-49d6-9a33-0d33da9b5644 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:32.908053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-37424980-f7f8-49d6-9a33-0d33da9b5644 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.908981 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-37424980-f7f8-49d6-9a33-0d33da9b5644 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:32.917041 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-37424980-f7f8-49d6-9a33-0d33da9b5644 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:32.917041 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-37424980-f7f8-49d6-9a33-0d33da9b5644 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.149569 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c76b78c1-3ad1-41dd-bf3b-dd7437eb6be4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.161887 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c76b78c1-3ad1-41dd-bf3b-dd7437eb6be4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.432677 Jul 18 02:35:33.163097 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 30/80] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:32 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:33.177656 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7fcdb06f-2e2a-482f-a8ec-8453e5e0e233 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:33.178827 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7fcdb06f-2e2a-482f-a8ec-8453e5e0e233 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:33.187319 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7fcdb06f-2e2a-482f-a8ec-8453e5e0e233 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:33.188100 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7fcdb06f-2e2a-482f-a8ec-8453e5e0e233 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.189122 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7fcdb06f-2e2a-482f-a8ec-8453e5e0e233 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:33.189568 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7fcdb06f-2e2a-482f-a8ec-8453e5e0e233 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.299854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7fcdb06f-2e2a-482f-a8ec-8453e5e0e233 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.315224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7fcdb06f-2e2a-482f-a8ec-8453e5e0e233 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1299 microversion: 2.1 time: 0.147469 Jul 18 02:35:33.328600 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 31/81] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:33 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:33.406748 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-dffe56bb-2e9f-458c-8d47-54f23e53a055 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:33.407608 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-dffe56bb-2e9f-458c-8d47-54f23e53a055 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:33.415653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dffe56bb-2e9f-458c-8d47-54f23e53a055 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:33.420735 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dffe56bb-2e9f-458c-8d47-54f23e53a055 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.421685 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dffe56bb-2e9f-458c-8d47-54f23e53a055 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:33.422199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dffe56bb-2e9f-458c-8d47-54f23e53a055 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:33.515752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dffe56bb-2e9f-458c-8d47-54f23e53a055 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.524878 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dffe56bb-2e9f-458c-8d47-54f23e53a055 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.526724 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dffe56bb-2e9f-458c-8d47-54f23e53a055 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.528289 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-dffe56bb-2e9f-458c-8d47-54f23e53a055 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1340 microversion: 2.20 time: 0.131113 Jul 18 02:35:33.529431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 32/82] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:33 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1340 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:33.644327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-37424980-f7f8-49d6-9a33-0d33da9b5644 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:33.661984 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-37424980-f7f8-49d6-9a33-0d33da9b5644 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.764913 Jul 18 02:35:33.663047 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 51/83] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:32 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:34.197470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a9b4f61d-5031-48c7-8797-b468e2aa16b0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:34.200252 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a9b4f61d-5031-48c7-8797-b468e2aa16b0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:34.219420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a9b4f61d-5031-48c7-8797-b468e2aa16b0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.230653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a9b4f61d-5031-48c7-8797-b468e2aa16b0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.231910 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a9b4f61d-5031-48c7-8797-b468e2aa16b0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.232594 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a9b4f61d-5031-48c7-8797-b468e2aa16b0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.339053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7b4c9302-fa07-497e-b66d-8e33ade12d54 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:34.340586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7b4c9302-fa07-497e-b66d-8e33ade12d54 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:34.368048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7b4c9302-fa07-497e-b66d-8e33ade12d54 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.368048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7b4c9302-fa07-497e-b66d-8e33ade12d54 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.368048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7b4c9302-fa07-497e-b66d-8e33ade12d54 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.368048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7b4c9302-fa07-497e-b66d-8e33ade12d54 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.531998 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a9b4f61d-5031-48c7-8797-b468e2aa16b0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.532759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7b4c9302-fa07-497e-b66d-8e33ade12d54 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.540044 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a9b4f61d-5031-48c7-8797-b468e2aa16b0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.362676 Jul 18 02:35:34.542653 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7b4c9302-fa07-497e-b66d-8e33ade12d54 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1299 microversion: 2.1 time: 0.208754 Jul 18 02:35:34.546026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 52/84] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:34 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:34.554315 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 33/85] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:34 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:34.565587 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-890812c2-1d06-413e-84d1-3dad7bf465cb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:34.574442 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-890812c2-1d06-413e-84d1-3dad7bf465cb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:34.583311 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-890812c2-1d06-413e-84d1-3dad7bf465cb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.583949 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-890812c2-1d06-413e-84d1-3dad7bf465cb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.587137 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-890812c2-1d06-413e-84d1-3dad7bf465cb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.589286 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-890812c2-1d06-413e-84d1-3dad7bf465cb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.679438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9f22a290-8590-4198-bd22-2c9aaf1da506 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:34.680336 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9f22a290-8590-4198-bd22-2c9aaf1da506 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:34.683628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:34.842708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f22a290-8590-4198-bd22-2c9aaf1da506 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.842708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f22a290-8590-4198-bd22-2c9aaf1da506 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.842708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f22a290-8590-4198-bd22-2c9aaf1da506 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:34.842708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f22a290-8590-4198-bd22-2c9aaf1da506 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:34.863458 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-890812c2-1d06-413e-84d1-3dad7bf465cb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.899414 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-890812c2-1d06-413e-84d1-3dad7bf465cb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.916173 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-890812c2-1d06-413e-84d1-3dad7bf465cb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:34.917572 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-890812c2-1d06-413e-84d1-3dad7bf465cb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1340 microversion: 2.20 time: 0.355909 Jul 18 02:35:34.928068 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 53/86] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:34 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1340 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:35.189985 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9f22a290-8590-4198-bd22-2c9aaf1da506 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:35.210785 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9f22a290-8590-4198-bd22-2c9aaf1da506 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.522981 Jul 18 02:35:35.221055 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 34/87] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:34 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:35.576230 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-62a73087-f0a4-4812-89ab-6519eb83bfac tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:35.586249 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-62a73087-f0a4-4812-89ab-6519eb83bfac tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:35.586796 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-04eb2017-dbcb-4977-b66b-a9baea6c8e26 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:35.586796 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-04eb2017-dbcb-4977-b66b-a9baea6c8e26 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:35.611491 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04eb2017-dbcb-4977-b66b-a9baea6c8e26 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.612106 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-62a73087-f0a4-4812-89ab-6519eb83bfac tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.634328 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-62a73087-f0a4-4812-89ab-6519eb83bfac tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.634582 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04eb2017-dbcb-4977-b66b-a9baea6c8e26 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.638632 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-62a73087-f0a4-4812-89ab-6519eb83bfac tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.639133 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04eb2017-dbcb-4977-b66b-a9baea6c8e26 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.641349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04eb2017-dbcb-4977-b66b-a9baea6c8e26 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.641539 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-62a73087-f0a4-4812-89ab-6519eb83bfac tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.922925 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-04eb2017-dbcb-4977-b66b-a9baea6c8e26 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:35.933423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-04eb2017-dbcb-4977-b66b-a9baea6c8e26 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.374569 Jul 18 02:35:35.934572 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 35/88] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:35 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:35.944413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5a84d91a-b4a3-4bbd-a24d-ea90c3c8312f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:35.945429 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-5a84d91a-b4a3-4bbd-a24d-ea90c3c8312f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:35.953214 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5a84d91a-b4a3-4bbd-a24d-ea90c3c8312f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.954436 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5a84d91a-b4a3-4bbd-a24d-ea90c3c8312f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:35.955698 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5a84d91a-b4a3-4bbd-a24d-ea90c3c8312f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:35.956504 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5a84d91a-b4a3-4bbd-a24d-ea90c3c8312f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.216237 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5a84d91a-b4a3-4bbd-a24d-ea90c3c8312f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.238451 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-62a73087-f0a4-4812-89ab-6519eb83bfac tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.243144 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:36.244785 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5a84d91a-b4a3-4bbd-a24d-ea90c3c8312f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.253581 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5a84d91a-b4a3-4bbd-a24d-ea90c3c8312f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.254694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-62a73087-f0a4-4812-89ab-6519eb83bfac tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.698977 Jul 18 02:35:36.255778 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 54/89] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:35 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:36.258853 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5a84d91a-b4a3-4bbd-a24d-ea90c3c8312f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.318465 Jul 18 02:35:36.264667 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3288d5fd-1bd7-4191-a650-71800fc70820 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:36.269970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3288d5fd-1bd7-4191-a650-71800fc70820 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:36.278269 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 36/90] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:35 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:36.286980 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3288d5fd-1bd7-4191-a650-71800fc70820 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.287447 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3288d5fd-1bd7-4191-a650-71800fc70820 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.288280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3288d5fd-1bd7-4191-a650-71800fc70820 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.288764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3288d5fd-1bd7-4191-a650-71800fc70820 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.657079 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:36.664067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3288d5fd-1bd7-4191-a650-71800fc70820 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:36.681136 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3288d5fd-1bd7-4191-a650-71800fc70820 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.420904 Jul 18 02:35:36.681723 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 55/91] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:36 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:36.954149 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-57467d83-e056-4c34-96ec-eb56c29f0f85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:36.955269 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-57467d83-e056-4c34-96ec-eb56c29f0f85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:36.962050 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-57467d83-e056-4c34-96ec-eb56c29f0f85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.963027 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-57467d83-e056-4c34-96ec-eb56c29f0f85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:36.964131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-57467d83-e056-4c34-96ec-eb56c29f0f85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:36.965797 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-57467d83-e056-4c34-96ec-eb56c29f0f85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.263594 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-57467d83-e056-4c34-96ec-eb56c29f0f85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.273343 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-57467d83-e056-4c34-96ec-eb56c29f0f85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.323847 Jul 18 02:35:37.281065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 37/92] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:36 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:37.286341 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3892efd9-77f7-4289-a023-198ca510fb37 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:37.288191 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3892efd9-77f7-4289-a023-198ca510fb37 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:37.291420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e7a175d5-9691-4658-ac8e-b14c44cfd4fc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:37.292320 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e7a175d5-9691-4658-ac8e-b14c44cfd4fc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:37.296799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3892efd9-77f7-4289-a023-198ca510fb37 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:37.297631 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3892efd9-77f7-4289-a023-198ca510fb37 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.298831 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3892efd9-77f7-4289-a023-198ca510fb37 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:37.309291 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3892efd9-77f7-4289-a023-198ca510fb37 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.319959 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e7a175d5-9691-4658-ac8e-b14c44cfd4fc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:37.335028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e7a175d5-9691-4658-ac8e-b14c44cfd4fc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.336103 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e7a175d5-9691-4658-ac8e-b14c44cfd4fc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:37.342371 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e7a175d5-9691-4658-ac8e-b14c44cfd4fc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.647092 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e7a175d5-9691-4658-ac8e-b14c44cfd4fc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.658430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e7a175d5-9691-4658-ac8e-b14c44cfd4fc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.660155 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e7a175d5-9691-4658-ac8e-b14c44cfd4fc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.661497 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e7a175d5-9691-4658-ac8e-b14c44cfd4fc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.383715 Jul 18 02:35:37.662851 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 38/93] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:37 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:37.699305 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-86291a1e-df86-4fe5-8f5b-88c75ea9f74c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:37.700355 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-86291a1e-df86-4fe5-8f5b-88c75ea9f74c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:37.710690 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-86291a1e-df86-4fe5-8f5b-88c75ea9f74c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:37.711379 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-86291a1e-df86-4fe5-8f5b-88c75ea9f74c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.713015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-86291a1e-df86-4fe5-8f5b-88c75ea9f74c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:37.715818 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-86291a1e-df86-4fe5-8f5b-88c75ea9f74c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:37.725701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:37.939020 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-86291a1e-df86-4fe5-8f5b-88c75ea9f74c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.949984 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-86291a1e-df86-4fe5-8f5b-88c75ea9f74c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.253001 Jul 18 02:35:37.953677 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 39/94] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:37 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:37.987472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3892efd9-77f7-4289-a023-198ca510fb37 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:37.999196 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3892efd9-77f7-4289-a023-198ca510fb37 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.729384 Jul 18 02:35:38.000646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 56/95] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:37 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:38.131375 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=28 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:38.278587 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-968bd3aa-41b7-490d-92af-50da38eff6cc req-a112e01f-2efa-4bea-bd1c-2cd164062dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1905a0-2c49-40f1-921a-0fda9997cdb3", "tag": "f7b04923-0911-4df9-b770-512e41d840f9"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:38.299354 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-968bd3aa-41b7-490d-92af-50da38eff6cc req-a112e01f-2efa-4bea-bd1c-2cd164062dd2 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.300380 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-dc068a2b-ecfa-4494-bd6e-8cc6492fb4f2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:38.300380 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-dc068a2b-ecfa-4494-bd6e-8cc6492fb4f2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:38.300846 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-968bd3aa-41b7-490d-92af-50da38eff6cc req-a112e01f-2efa-4bea-bd1c-2cd164062dd2 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.310309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=24 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:38.312698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:38.314762 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc068a2b-ecfa-4494-bd6e-8cc6492fb4f2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.315399 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc068a2b-ecfa-4494-bd6e-8cc6492fb4f2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.316351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc068a2b-ecfa-4494-bd6e-8cc6492fb4f2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.316940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc068a2b-ecfa-4494-bd6e-8cc6492fb4f2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.344227 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-968bd3aa-41b7-490d-92af-50da38eff6cc req-a112e01f-2efa-4bea-bd1c-2cd164062dd2 service nova] Creating event network-changed:f7b04923-0911-4df9-b770-512e41d840f9 for instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 on hv-cinder-85001 Jul 18 02:35:38.358153 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-968bd3aa-41b7-490d-92af-50da38eff6cc req-a112e01f-2efa-4bea-bd1c-2cd164062dd2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.402409 Jul 18 02:35:38.360981 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 40/96] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:38.566026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-dc068a2b-ecfa-4494-bd6e-8cc6492fb4f2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:38.574018 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-dc068a2b-ecfa-4494-bd6e-8cc6492fb4f2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.285847 Jul 18 02:35:38.575086 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 57/97] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:38 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:38.682017 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-25a42836-97a5-4a00-9cf8-dc0329dee4f0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:38.683091 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-25a42836-97a5-4a00-9cf8-dc0329dee4f0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:38.690887 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-25a42836-97a5-4a00-9cf8-dc0329dee4f0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.691239 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-25a42836-97a5-4a00-9cf8-dc0329dee4f0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.692009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-25a42836-97a5-4a00-9cf8-dc0329dee4f0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.692442 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-25a42836-97a5-4a00-9cf8-dc0329dee4f0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.841166 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-25a42836-97a5-4a00-9cf8-dc0329dee4f0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:38.850280 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-25a42836-97a5-4a00-9cf8-dc0329dee4f0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:38.852393 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-25a42836-97a5-4a00-9cf8-dc0329dee4f0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:38.853546 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-25a42836-97a5-4a00-9cf8-dc0329dee4f0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.176072 Jul 18 02:35:38.854114 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 41/98] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:38 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:38.970556 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7b52159d-a107-4f95-b20f-5b25864ee9a7 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:38.971309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7b52159d-a107-4f95-b20f-5b25864ee9a7 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:38.977386 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7b52159d-a107-4f95-b20f-5b25864ee9a7 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.978040 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7b52159d-a107-4f95-b20f-5b25864ee9a7 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:38.978881 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7b52159d-a107-4f95-b20f-5b25864ee9a7 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:38.982958 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7b52159d-a107-4f95-b20f-5b25864ee9a7 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.024082 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bf570b04-1a50-41ca-9e36-c00df86d02e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:39.024604 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bf570b04-1a50-41ca-9e36-c00df86d02e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:39.032049 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bf570b04-1a50-41ca-9e36-c00df86d02e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.032499 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bf570b04-1a50-41ca-9e36-c00df86d02e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.033263 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bf570b04-1a50-41ca-9e36-c00df86d02e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.033967 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bf570b04-1a50-41ca-9e36-c00df86d02e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.146506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7b52159d-a107-4f95-b20f-5b25864ee9a7 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:39.161585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7b52159d-a107-4f95-b20f-5b25864ee9a7 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.194870 Jul 18 02:35:39.163821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 58/99] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:38 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:39.202572 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bf570b04-1a50-41ca-9e36-c00df86d02e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:39.212855 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bf570b04-1a50-41ca-9e36-c00df86d02e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.193257 Jul 18 02:35:39.213687 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 42/100] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:39 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:39.595443 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5f2714d2-6bd7-4077-a788-ec24334d846e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:39.618501 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5f2714d2-6bd7-4077-a788-ec24334d846e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:39.630956 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f2714d2-6bd7-4077-a788-ec24334d846e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.630956 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f2714d2-6bd7-4077-a788-ec24334d846e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.630956 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f2714d2-6bd7-4077-a788-ec24334d846e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.631563 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f2714d2-6bd7-4077-a788-ec24334d846e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.883686 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2929f1ea-cd3e-4cae-a5ab-bc7ce865b674 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:39.887251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2929f1ea-cd3e-4cae-a5ab-bc7ce865b674 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:39.896757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2929f1ea-cd3e-4cae-a5ab-bc7ce865b674 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.897487 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2929f1ea-cd3e-4cae-a5ab-bc7ce865b674 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:39.898934 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2929f1ea-cd3e-4cae-a5ab-bc7ce865b674 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:39.899411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2929f1ea-cd3e-4cae-a5ab-bc7ce865b674 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.059747 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2929f1ea-cd3e-4cae-a5ab-bc7ce865b674 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:40.067778 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2929f1ea-cd3e-4cae-a5ab-bc7ce865b674 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:40.069279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2929f1ea-cd3e-4cae-a5ab-bc7ce865b674 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:40.070415 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2929f1ea-cd3e-4cae-a5ab-bc7ce865b674 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.201872 Jul 18 02:35:40.071045 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 43/101] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:39 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:40.142171 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5f2714d2-6bd7-4077-a788-ec24334d846e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:40.150042 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5f2714d2-6bd7-4077-a788-ec24334d846e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.562056 Jul 18 02:35:40.150985 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 59/102] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:39 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:40.183504 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9a2c13d6-3dd6-4c06-8e08-464185069cc9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:40.188252 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9a2c13d6-3dd6-4c06-8e08-464185069cc9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:40.198368 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9a2c13d6-3dd6-4c06-8e08-464185069cc9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.198368 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9a2c13d6-3dd6-4c06-8e08-464185069cc9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.199256 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9a2c13d6-3dd6-4c06-8e08-464185069cc9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.199672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9a2c13d6-3dd6-4c06-8e08-464185069cc9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.231725 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6ff21ff1-6769-4f2b-aa7c-5e5ada4346b3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:40.232594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6ff21ff1-6769-4f2b-aa7c-5e5ada4346b3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:40.243033 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ff21ff1-6769-4f2b-aa7c-5e5ada4346b3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.245480 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ff21ff1-6769-4f2b-aa7c-5e5ada4346b3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.248458 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ff21ff1-6769-4f2b-aa7c-5e5ada4346b3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.248906 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ff21ff1-6769-4f2b-aa7c-5e5ada4346b3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.413137 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9a2c13d6-3dd6-4c06-8e08-464185069cc9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:40.423076 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9a2c13d6-3dd6-4c06-8e08-464185069cc9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.246926 Jul 18 02:35:40.424098 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 44/103] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:40 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:40.429860 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-46835089-ba05-4c67-b2a0-078fbdfc1654 req-2688fac7-8d9f-4eb3-a9bb-0d684f28407c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d974b9-4abf-4d7f-bbea-08e8fef381dd", "tag": "3185ab6e-a508-4ad1-b269-07229430860b"}, {"name": "network-changed", "server_uuid": "b883c80f-57dd-43cb-a44e-72b33a2128e9", "tag": "063ebb17-b759-41b1-bb29-1214343746a1"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:40.441851 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-46835089-ba05-4c67-b2a0-078fbdfc1654 req-2688fac7-8d9f-4eb3-a9bb-0d684f28407c service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:40.442486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-46835089-ba05-4c67-b2a0-078fbdfc1654 req-2688fac7-8d9f-4eb3-a9bb-0d684f28407c service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:40.456120 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-46835089-ba05-4c67-b2a0-078fbdfc1654 req-2688fac7-8d9f-4eb3-a9bb-0d684f28407c service nova] Creating event network-changed:3185ab6e-a508-4ad1-b269-07229430860b for instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd on hv-cinder-85001 Jul 18 02:35:40.456728 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-46835089-ba05-4c67-b2a0-078fbdfc1654 req-2688fac7-8d9f-4eb3-a9bb-0d684f28407c service nova] Creating event network-changed:063ebb17-b759-41b1-bb29-1214343746a1 for instance b883c80f-57dd-43cb-a44e-72b33a2128e9 on hv-cinder-85001 Jul 18 02:35:40.463255 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-46835089-ba05-4c67-b2a0-078fbdfc1654 req-2688fac7-8d9f-4eb3-a9bb-0d684f28407c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037904 Jul 18 02:35:40.464007 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 45/104] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:40.609103 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6ff21ff1-6769-4f2b-aa7c-5e5ada4346b3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:40.638270 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6ff21ff1-6769-4f2b-aa7c-5e5ada4346b3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.410869 Jul 18 02:35:40.639280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 60/105] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:40 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:41.087375 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=6 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:41.093817 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e936df4f-75aa-43d0-90ac-2259f16f9adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:41.094750 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e936df4f-75aa-43d0-90ac-2259f16f9adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:41.108930 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e936df4f-75aa-43d0-90ac-2259f16f9adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.108930 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e936df4f-75aa-43d0-90ac-2259f16f9adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.108930 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e936df4f-75aa-43d0-90ac-2259f16f9adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.108930 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e936df4f-75aa-43d0-90ac-2259f16f9adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.167775 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a20f6ca4-d1a7-482f-843f-f2a356c69aa7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:41.169187 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a20f6ca4-d1a7-482f-843f-f2a356c69aa7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:41.175894 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a20f6ca4-d1a7-482f-843f-f2a356c69aa7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.176441 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a20f6ca4-d1a7-482f-843f-f2a356c69aa7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.177382 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a20f6ca4-d1a7-482f-843f-f2a356c69aa7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.177968 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a20f6ca4-d1a7-482f-843f-f2a356c69aa7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.305312 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e936df4f-75aa-43d0-90ac-2259f16f9adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:41.327927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e936df4f-75aa-43d0-90ac-2259f16f9adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:41.330553 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e936df4f-75aa-43d0-90ac-2259f16f9adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:41.331861 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e936df4f-75aa-43d0-90ac-2259f16f9adc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.245487 Jul 18 02:35:41.333314 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 46/106] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:41 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:41.442150 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-68e75de9-6cd5-47d3-bc2a-58069cf4a4b9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:41.442844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-68e75de9-6cd5-47d3-bc2a-58069cf4a4b9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:41.446211 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a20f6ca4-d1a7-482f-843f-f2a356c69aa7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:41.451513 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-68e75de9-6cd5-47d3-bc2a-58069cf4a4b9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.452191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-68e75de9-6cd5-47d3-bc2a-58069cf4a4b9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.453116 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-68e75de9-6cd5-47d3-bc2a-58069cf4a4b9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.453695 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-68e75de9-6cd5-47d3-bc2a-58069cf4a4b9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.465741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a20f6ca4-d1a7-482f-843f-f2a356c69aa7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.299872 Jul 18 02:35:41.468142 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 61/107] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:41 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:41.656731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-288cca44-9f05-43d2-a43c-2d31c94a6965 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:41.657384 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-288cca44-9f05-43d2-a43c-2d31c94a6965 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:41.665772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-288cca44-9f05-43d2-a43c-2d31c94a6965 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.666250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-288cca44-9f05-43d2-a43c-2d31c94a6965 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.669683 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-288cca44-9f05-43d2-a43c-2d31c94a6965 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:41.670410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-288cca44-9f05-43d2-a43c-2d31c94a6965 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:41.821432 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-288cca44-9f05-43d2-a43c-2d31c94a6965 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:41.823187 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-68e75de9-6cd5-47d3-bc2a-58069cf4a4b9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:41.829145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-288cca44-9f05-43d2-a43c-2d31c94a6965 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.177232 Jul 18 02:35:41.829733 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 62/108] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:41 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:41.831921 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-68e75de9-6cd5-47d3-bc2a-58069cf4a4b9 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.394837 Jul 18 02:35:41.832475 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 47/109] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:41 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:42.351091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-790c3f98-5388-4e26-bd17-e048339e865d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:42.351521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-790c3f98-5388-4e26-bd17-e048339e865d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:42.359417 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-790c3f98-5388-4e26-bd17-e048339e865d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.360156 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-790c3f98-5388-4e26-bd17-e048339e865d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.361080 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-790c3f98-5388-4e26-bd17-e048339e865d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.361647 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-790c3f98-5388-4e26-bd17-e048339e865d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.483140 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a3b7d3ff-7f15-4116-bd48-9d1fd4ee1cbb tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:42.483778 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a3b7d3ff-7f15-4116-bd48-9d1fd4ee1cbb tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:42.490205 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3b7d3ff-7f15-4116-bd48-9d1fd4ee1cbb tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.490647 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3b7d3ff-7f15-4116-bd48-9d1fd4ee1cbb tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.491577 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3b7d3ff-7f15-4116-bd48-9d1fd4ee1cbb tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.492163 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3b7d3ff-7f15-4116-bd48-9d1fd4ee1cbb tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.585433 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-790c3f98-5388-4e26-bd17-e048339e865d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:42.596879 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-790c3f98-5388-4e26-bd17-e048339e865d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:42.598980 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-790c3f98-5388-4e26-bd17-e048339e865d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:42.600301 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-790c3f98-5388-4e26-bd17-e048339e865d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.253201 Jul 18 02:35:42.601328 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 63/110] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:42 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:42.643006 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a3b7d3ff-7f15-4116-bd48-9d1fd4ee1cbb tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:42.650758 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a3b7d3ff-7f15-4116-bd48-9d1fd4ee1cbb tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.172543 Jul 18 02:35:42.652271 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 48/111] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:42 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:42.845951 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3e77f487-ec4c-43bc-815a-3c964bb710e4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:42.846614 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3e77f487-ec4c-43bc-815a-3c964bb710e4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:42.848493 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-862b700e-45d0-4061-99e9-9613c0ca06c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:42.849129 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-862b700e-45d0-4061-99e9-9613c0ca06c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:42.855099 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3e77f487-ec4c-43bc-815a-3c964bb710e4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.855539 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3e77f487-ec4c-43bc-815a-3c964bb710e4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.856320 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3e77f487-ec4c-43bc-815a-3c964bb710e4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.856757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3e77f487-ec4c-43bc-815a-3c964bb710e4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.857514 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-862b700e-45d0-4061-99e9-9613c0ca06c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.857981 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-862b700e-45d0-4061-99e9-9613c0ca06c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:42.858960 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-862b700e-45d0-4061-99e9-9613c0ca06c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:42.859576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-862b700e-45d0-4061-99e9-9613c0ca06c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:43.052378 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-862b700e-45d0-4061-99e9-9613c0ca06c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:43.063005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-862b700e-45d0-4061-99e9-9613c0ca06c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.218285 Jul 18 02:35:43.066214 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 49/112] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:42 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:43.195345 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3e77f487-ec4c-43bc-815a-3c964bb710e4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:43.209317 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3e77f487-ec4c-43bc-815a-3c964bb710e4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.367121 Jul 18 02:35:43.229209 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 64/113] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:42 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:43.625624 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0818a262-7beb-4fe4-b5d2-795fbf488ac6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:43.627808 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0818a262-7beb-4fe4-b5d2-795fbf488ac6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:43.643211 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0818a262-7beb-4fe4-b5d2-795fbf488ac6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.643918 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0818a262-7beb-4fe4-b5d2-795fbf488ac6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:43.646209 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0818a262-7beb-4fe4-b5d2-795fbf488ac6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.647047 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0818a262-7beb-4fe4-b5d2-795fbf488ac6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:43.669110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a234ec3d-5484-4f8e-b970-e0c946380472 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:43.670488 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a234ec3d-5484-4f8e-b970-e0c946380472 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:43.689607 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a234ec3d-5484-4f8e-b970-e0c946380472 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.691257 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a234ec3d-5484-4f8e-b970-e0c946380472 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:43.692132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a234ec3d-5484-4f8e-b970-e0c946380472 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:43.692724 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a234ec3d-5484-4f8e-b970-e0c946380472 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:43.860872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0818a262-7beb-4fe4-b5d2-795fbf488ac6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:43.878021 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0818a262-7beb-4fe4-b5d2-795fbf488ac6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:43.880041 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0818a262-7beb-4fe4-b5d2-795fbf488ac6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:43.881774 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0818a262-7beb-4fe4-b5d2-795fbf488ac6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.260221 Jul 18 02:35:43.883927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 50/114] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:43 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:44.084595 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-043cc5a9-9e29-47a2-b1a9-7be3b78f6277 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:44.085897 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-043cc5a9-9e29-47a2-b1a9-7be3b78f6277 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:44.102315 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-043cc5a9-9e29-47a2-b1a9-7be3b78f6277 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.106793 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-043cc5a9-9e29-47a2-b1a9-7be3b78f6277 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.106793 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-043cc5a9-9e29-47a2-b1a9-7be3b78f6277 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.106793 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-043cc5a9-9e29-47a2-b1a9-7be3b78f6277 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.295115 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-043cc5a9-9e29-47a2-b1a9-7be3b78f6277 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:44.304388 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-043cc5a9-9e29-47a2-b1a9-7be3b78f6277 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.227087 Jul 18 02:35:44.305835 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a234ec3d-5484-4f8e-b970-e0c946380472 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:44.317423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 51/115] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:44 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:44.330373 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a234ec3d-5484-4f8e-b970-e0c946380472 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.666059 Jul 18 02:35:44.331266 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 65/116] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:43 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:44.336730 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2cee490f-2584-4d2e-9a1f-8230ad8bb617 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:44.337808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2cee490f-2584-4d2e-9a1f-8230ad8bb617 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:44.345298 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2cee490f-2584-4d2e-9a1f-8230ad8bb617 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.345985 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2cee490f-2584-4d2e-9a1f-8230ad8bb617 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.346978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2cee490f-2584-4d2e-9a1f-8230ad8bb617 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.347715 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2cee490f-2584-4d2e-9a1f-8230ad8bb617 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.580042 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-2cee490f-2584-4d2e-9a1f-8230ad8bb617 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:44.589141 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2cee490f-2584-4d2e-9a1f-8230ad8bb617 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.256477 Jul 18 02:35:44.590054 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 66/117] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:44 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:44.660679 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-97916741-a6c3-4a1a-94ac-a4863114d514 req-d555c7b5-3a42-4e80-849e-3fbb5c666589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0900bee1-a6cb-431f-9596-b1f13f8e8762", "name": "network-vif-plugged", "status": "completed", "tag": "b96e2133-e507-43d3-98e8-30f0e0715209"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:44.671518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-97916741-a6c3-4a1a-94ac-a4863114d514 req-d555c7b5-3a42-4e80-849e-3fbb5c666589 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.671518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-97916741-a6c3-4a1a-94ac-a4863114d514 req-d555c7b5-3a42-4e80-849e-3fbb5c666589 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.687320 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-97916741-a6c3-4a1a-94ac-a4863114d514 req-d555c7b5-3a42-4e80-849e-3fbb5c666589 service nova] Creating event network-vif-plugged:b96e2133-e507-43d3-98e8-30f0e0715209 for instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 on hv-cinder-85001 Jul 18 02:35:44.692493 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-97916741-a6c3-4a1a-94ac-a4863114d514 req-d555c7b5-3a42-4e80-849e-3fbb5c666589 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373655 Jul 18 02:35:44.700277 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 52/118] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:44.901388 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-88132096-13f7-4ff1-ba09-92df02622414 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:44.902343 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-88132096-13f7-4ff1-ba09-92df02622414 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:44.908695 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88132096-13f7-4ff1-ba09-92df02622414 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.912874 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88132096-13f7-4ff1-ba09-92df02622414 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:44.912874 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88132096-13f7-4ff1-ba09-92df02622414 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:44.912874 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88132096-13f7-4ff1-ba09-92df02622414 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:45.248627 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-88132096-13f7-4ff1-ba09-92df02622414 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:45.278971 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-88132096-13f7-4ff1-ba09-92df02622414 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:45.283702 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-88132096-13f7-4ff1-ba09-92df02622414 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:45.288486 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-88132096-13f7-4ff1-ba09-92df02622414 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.391228 Jul 18 02:35:45.295358 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 67/119] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:44 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:45.328586 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-73f52122-5dfb-4d7a-ab5b-d5a1b663260c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:45.330150 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-73f52122-5dfb-4d7a-ab5b-d5a1b663260c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:45.343086 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-73f52122-5dfb-4d7a-ab5b-d5a1b663260c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:45.344495 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-73f52122-5dfb-4d7a-ab5b-d5a1b663260c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:45.346507 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-73f52122-5dfb-4d7a-ab5b-d5a1b663260c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:45.348093 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-73f52122-5dfb-4d7a-ab5b-d5a1b663260c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:45.352999 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-eabd5314-3488-40b7-b974-f73809d16673 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:45.353789 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-eabd5314-3488-40b7-b974-f73809d16673 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:45.363677 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eabd5314-3488-40b7-b974-f73809d16673 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:45.364133 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eabd5314-3488-40b7-b974-f73809d16673 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:45.368017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eabd5314-3488-40b7-b974-f73809d16673 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:45.368476 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eabd5314-3488-40b7-b974-f73809d16673 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:45.573001 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-73f52122-5dfb-4d7a-ab5b-d5a1b663260c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:45.580963 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-73f52122-5dfb-4d7a-ab5b-d5a1b663260c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.259001 Jul 18 02:35:45.581549 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 53/120] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:45 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:45.609715 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-75d3b22f-4f5f-4384-98c7-627ccec2c33b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:45.610583 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-75d3b22f-4f5f-4384-98c7-627ccec2c33b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:45.619574 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75d3b22f-4f5f-4384-98c7-627ccec2c33b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:45.622669 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75d3b22f-4f5f-4384-98c7-627ccec2c33b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:45.627023 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75d3b22f-4f5f-4384-98c7-627ccec2c33b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:45.627545 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75d3b22f-4f5f-4384-98c7-627ccec2c33b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:45.717760 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-eabd5314-3488-40b7-b974-f73809d16673 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:45.730233 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-eabd5314-3488-40b7-b974-f73809d16673 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.380254 Jul 18 02:35:45.731331 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 68/121] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:45 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:45.828850 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-75d3b22f-4f5f-4384-98c7-627ccec2c33b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:45.838458 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-75d3b22f-4f5f-4384-98c7-627ccec2c33b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.234529 Jul 18 02:35:45.854997 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 54/122] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:45 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:46.311585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0e7ea0ff-82ce-4811-a228-00a6964a0dee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:46.312038 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0e7ea0ff-82ce-4811-a228-00a6964a0dee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:46.318452 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0e7ea0ff-82ce-4811-a228-00a6964a0dee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.318901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0e7ea0ff-82ce-4811-a228-00a6964a0dee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.319765 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0e7ea0ff-82ce-4811-a228-00a6964a0dee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.320359 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0e7ea0ff-82ce-4811-a228-00a6964a0dee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.465015 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0e7ea0ff-82ce-4811-a228-00a6964a0dee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:46.480811 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0e7ea0ff-82ce-4811-a228-00a6964a0dee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:46.480811 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0e7ea0ff-82ce-4811-a228-00a6964a0dee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:46.480811 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0e7ea0ff-82ce-4811-a228-00a6964a0dee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.171200 Jul 18 02:35:46.481205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 69/123] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:46 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:46.598468 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b1d027df-b963-4162-a4c5-ccd490826e2f tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:46.601741 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b1d027df-b963-4162-a4c5-ccd490826e2f tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:46.606016 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b1d027df-b963-4162-a4c5-ccd490826e2f tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.606497 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b1d027df-b963-4162-a4c5-ccd490826e2f tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.607267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b1d027df-b963-4162-a4c5-ccd490826e2f tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.607727 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b1d027df-b963-4162-a4c5-ccd490826e2f tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.708577 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-714e00fb-8f0b-48ad-ace8-10045c7f5b5d req-cfa13c3d-f086-4bd9-8204-ebbe7e83db3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1905a0-2c49-40f1-921a-0fda9997cdb3", "name": "network-vif-plugged", "status": "completed", "tag": "f7b04923-0911-4df9-b770-512e41d840f9"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:46.720996 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-714e00fb-8f0b-48ad-ace8-10045c7f5b5d req-cfa13c3d-f086-4bd9-8204-ebbe7e83db3b service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.721439 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-714e00fb-8f0b-48ad-ace8-10045c7f5b5d req-cfa13c3d-f086-4bd9-8204-ebbe7e83db3b service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.741323 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-714e00fb-8f0b-48ad-ace8-10045c7f5b5d req-cfa13c3d-f086-4bd9-8204-ebbe7e83db3b service nova] Creating event network-vif-plugged:f7b04923-0911-4df9-b770-512e41d840f9 for instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 on hv-cinder-85001 Jul 18 02:35:46.741952 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-714e00fb-8f0b-48ad-ace8-10045c7f5b5d req-cfa13c3d-f086-4bd9-8204-ebbe7e83db3b service nova] Acquired lock "compute-rpcapi-router" {{(pid=124891) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 02:35:46.743089 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-aff7f5b8-dfcc-4a8a-9406-b2bc842cf484 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.743528 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-aff7f5b8-dfcc-4a8a-9406-b2bc842cf484 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.744315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-aff7f5b8-dfcc-4a8a-9406-b2bc842cf484 None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.744420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b1d027df-b963-4162-a4c5-ccd490826e2f tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:46.744746 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-aff7f5b8-dfcc-4a8a-9406-b2bc842cf484 None None] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.752073 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b1d027df-b963-4162-a4c5-ccd490826e2f tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.157703 Jul 18 02:35:46.752636 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 55/124] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:46 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:46.753762 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.compute.rpcapi [None req-aff7f5b8-dfcc-4a8a-9406-b2bc842cf484 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 02:35:46.754666 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-aff7f5b8-dfcc-4a8a-9406-b2bc842cf484 None None] Releasing lock "compute-rpcapi-router" {{(pid=124891) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 02:35:46.757068 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-891017af-f529-49d6-a10b-7686a85e3135 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:46.757658 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-891017af-f529-49d6-a10b-7686a85e3135 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:46.764149 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-891017af-f529-49d6-a10b-7686a85e3135 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.764594 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-891017af-f529-49d6-a10b-7686a85e3135 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.765351 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-891017af-f529-49d6-a10b-7686a85e3135 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.765782 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-891017af-f529-49d6-a10b-7686a85e3135 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.775208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-aff7f5b8-dfcc-4a8a-9406-b2bc842cf484 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070302 Jul 18 02:35:46.775933 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 70/125] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:46.857395 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-34012984-d748-4e14-a22a-c2df2ba345a7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:46.858146 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-34012984-d748-4e14-a22a-c2df2ba345a7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:46.870343 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-34012984-d748-4e14-a22a-c2df2ba345a7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.870343 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-34012984-d748-4e14-a22a-c2df2ba345a7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.870343 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-34012984-d748-4e14-a22a-c2df2ba345a7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:46.870343 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-34012984-d748-4e14-a22a-c2df2ba345a7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:46.902306 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-891017af-f529-49d6-a10b-7686a85e3135 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:46.920853 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-891017af-f529-49d6-a10b-7686a85e3135 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.167013 Jul 18 02:35:46.921446 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 56/126] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:46 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:47.018705 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-34012984-d748-4e14-a22a-c2df2ba345a7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:47.023050 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:47.028371 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-34012984-d748-4e14-a22a-c2df2ba345a7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.176080 Jul 18 02:35:47.028941 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 71/127] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:46 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:47.496907 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b5e7310c-0997-4c76-a84a-5dad24554346 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:47.497650 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b5e7310c-0997-4c76-a84a-5dad24554346 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:47.503935 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b5e7310c-0997-4c76-a84a-5dad24554346 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:47.504451 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b5e7310c-0997-4c76-a84a-5dad24554346 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:47.505224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b5e7310c-0997-4c76-a84a-5dad24554346 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:47.507952 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b5e7310c-0997-4c76-a84a-5dad24554346 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:47.649652 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b5e7310c-0997-4c76-a84a-5dad24554346 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:47.653891 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:47.658888 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b5e7310c-0997-4c76-a84a-5dad24554346 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:47.660404 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b5e7310c-0997-4c76-a84a-5dad24554346 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:47.661532 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b5e7310c-0997-4c76-a84a-5dad24554346 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.168834 Jul 18 02:35:47.662322 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 57/128] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:47 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:47.768811 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-675f6f6a-a9f9-4ef8-a751-2ce36cdcd09e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:47.769418 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-675f6f6a-a9f9-4ef8-a751-2ce36cdcd09e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:47.776053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-675f6f6a-a9f9-4ef8-a751-2ce36cdcd09e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:47.777132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-675f6f6a-a9f9-4ef8-a751-2ce36cdcd09e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:47.778119 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-675f6f6a-a9f9-4ef8-a751-2ce36cdcd09e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:47.778743 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-675f6f6a-a9f9-4ef8-a751-2ce36cdcd09e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:47.938761 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e86f7788-9d7c-417f-b59d-c5e2a8ab8547 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:47.939641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e86f7788-9d7c-417f-b59d-c5e2a8ab8547 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:47.946512 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e86f7788-9d7c-417f-b59d-c5e2a8ab8547 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:47.947128 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e86f7788-9d7c-417f-b59d-c5e2a8ab8547 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:47.948085 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e86f7788-9d7c-417f-b59d-c5e2a8ab8547 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:47.948678 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e86f7788-9d7c-417f-b59d-c5e2a8ab8547 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:47.955541 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-675f6f6a-a9f9-4ef8-a751-2ce36cdcd09e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:47.982762 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-675f6f6a-a9f9-4ef8-a751-2ce36cdcd09e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.217682 Jul 18 02:35:47.984769 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 72/129] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:47 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:48.045522 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-83744c35-d805-49d6-aa6f-4132c7d74571 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:48.046231 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-83744c35-d805-49d6-aa6f-4132c7d74571 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:48.052327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-83744c35-d805-49d6-aa6f-4132c7d74571 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:48.052776 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-83744c35-d805-49d6-aa6f-4132c7d74571 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:48.053533 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-83744c35-d805-49d6-aa6f-4132c7d74571 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:48.055795 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-83744c35-d805-49d6-aa6f-4132c7d74571 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:48.139800 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e86f7788-9d7c-417f-b59d-c5e2a8ab8547 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:48.147610 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e86f7788-9d7c-417f-b59d-c5e2a8ab8547 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.213049 Jul 18 02:35:48.148382 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 58/130] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:47 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:48.191938 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-83744c35-d805-49d6-aa6f-4132c7d74571 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:48.199522 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-83744c35-d805-49d6-aa6f-4132c7d74571 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.158678 Jul 18 02:35:48.200093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 73/131] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:48 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:48.679674 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bb64b79f-b132-41b8-be23-95d7ca27ce2d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:48.680336 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bb64b79f-b132-41b8-be23-95d7ca27ce2d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:48.693402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bb64b79f-b132-41b8-be23-95d7ca27ce2d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:48.698510 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bb64b79f-b132-41b8-be23-95d7ca27ce2d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:48.698510 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bb64b79f-b132-41b8-be23-95d7ca27ce2d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:48.698510 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bb64b79f-b132-41b8-be23-95d7ca27ce2d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:48.833199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bb64b79f-b132-41b8-be23-95d7ca27ce2d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:48.842231 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bb64b79f-b132-41b8-be23-95d7ca27ce2d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:48.843882 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bb64b79f-b132-41b8-be23-95d7ca27ce2d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:48.845814 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bb64b79f-b132-41b8-be23-95d7ca27ce2d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.169810 Jul 18 02:35:48.865926 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 59/132] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:48 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:49.001700 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7bed80b7-0829-4516-bf10-5ac38e5c70c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:49.002458 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7bed80b7-0829-4516-bf10-5ac38e5c70c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:49.009003 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7bed80b7-0829-4516-bf10-5ac38e5c70c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.009569 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7bed80b7-0829-4516-bf10-5ac38e5c70c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.010454 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7bed80b7-0829-4516-bf10-5ac38e5c70c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.010960 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7bed80b7-0829-4516-bf10-5ac38e5c70c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.160616 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7bed80b7-0829-4516-bf10-5ac38e5c70c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:49.164876 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7ae0cb79-44d8-41ae-bd24-7c9b35569804 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:49.165973 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7ae0cb79-44d8-41ae-bd24-7c9b35569804 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:49.171165 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7bed80b7-0829-4516-bf10-5ac38e5c70c0 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.174170 Jul 18 02:35:49.171756 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 74/133] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:48 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:49.173120 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7ae0cb79-44d8-41ae-bd24-7c9b35569804 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.173569 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7ae0cb79-44d8-41ae-bd24-7c9b35569804 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.174356 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7ae0cb79-44d8-41ae-bd24-7c9b35569804 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.174787 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7ae0cb79-44d8-41ae-bd24-7c9b35569804 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.216898 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-93a7ce5c-72a7-4e9a-bae1-e87bf3021403 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:49.217436 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-93a7ce5c-72a7-4e9a-bae1-e87bf3021403 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:49.223664 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93a7ce5c-72a7-4e9a-bae1-e87bf3021403 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.224121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93a7ce5c-72a7-4e9a-bae1-e87bf3021403 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.226298 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93a7ce5c-72a7-4e9a-bae1-e87bf3021403 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.226749 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93a7ce5c-72a7-4e9a-bae1-e87bf3021403 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.367093 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7ae0cb79-44d8-41ae-bd24-7c9b35569804 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:49.382440 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7ae0cb79-44d8-41ae-bd24-7c9b35569804 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.219342 Jul 18 02:35:49.384057 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 60/134] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:49 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:49.390977 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-93a7ce5c-72a7-4e9a-bae1-e87bf3021403 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:49.400316 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-93a7ce5c-72a7-4e9a-bae1-e87bf3021403 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1363 microversion: 2.1 time: 0.187942 Jul 18 02:35:49.401589 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 75/135] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:49 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:49.864090 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0c021394-b189-40eb-8bec-9239071000c7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:49.864699 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0c021394-b189-40eb-8bec-9239071000c7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:49.870838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0c021394-b189-40eb-8bec-9239071000c7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.871290 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0c021394-b189-40eb-8bec-9239071000c7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:49.872051 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0c021394-b189-40eb-8bec-9239071000c7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:49.872489 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0c021394-b189-40eb-8bec-9239071000c7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.021160 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0c021394-b189-40eb-8bec-9239071000c7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:50.030651 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0c021394-b189-40eb-8bec-9239071000c7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:50.032226 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0c021394-b189-40eb-8bec-9239071000c7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:50.033337 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0c021394-b189-40eb-8bec-9239071000c7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.173266 Jul 18 02:35:50.034058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 61/136] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:49 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:50.192653 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ab426565-01c9-4bf2-acd6-94403c15e70e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:50.194143 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ab426565-01c9-4bf2-acd6-94403c15e70e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:50.202051 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab426565-01c9-4bf2-acd6-94403c15e70e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.205076 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab426565-01c9-4bf2-acd6-94403c15e70e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.205076 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab426565-01c9-4bf2-acd6-94403c15e70e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.205076 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab426565-01c9-4bf2-acd6-94403c15e70e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.348495 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ab426565-01c9-4bf2-acd6-94403c15e70e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:50.356578 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ab426565-01c9-4bf2-acd6-94403c15e70e tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1315 microversion: 2.1 time: 0.171142 Jul 18 02:35:50.362736 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 76/137] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:50 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:50.401833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ba068470-62c3-447a-b95e-861a66752062 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:50.402604 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-ba068470-62c3-447a-b95e-861a66752062 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:50.412666 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ba068470-62c3-447a-b95e-861a66752062 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.412666 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ba068470-62c3-447a-b95e-861a66752062 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.412666 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ba068470-62c3-447a-b95e-861a66752062 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.412666 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ba068470-62c3-447a-b95e-861a66752062 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.421771 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5d7448de-0327-4157-b7ae-b131d6d3904a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:50.423018 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5d7448de-0327-4157-b7ae-b131d6d3904a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:50.433005 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5d7448de-0327-4157-b7ae-b131d6d3904a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.436255 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5d7448de-0327-4157-b7ae-b131d6d3904a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.437307 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5d7448de-0327-4157-b7ae-b131d6d3904a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.437849 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5d7448de-0327-4157-b7ae-b131d6d3904a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.629446 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ba068470-62c3-447a-b95e-861a66752062 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:50.641742 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ba068470-62c3-447a-b95e-861a66752062 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.244510 Jul 18 02:35:50.651906 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 62/138] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:50 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:50.662918 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-83c252c5-f14a-47c2-90bb-9c46d5346ed5 req-fd0f99af-60d6-4cad-8d86-0cb03d53df8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b883c80f-57dd-43cb-a44e-72b33a2128e9", "name": "network-vif-plugged", "status": "completed", "tag": "063ebb17-b759-41b1-bb29-1214343746a1"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:50.672036 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-83c252c5-f14a-47c2-90bb-9c46d5346ed5 req-fd0f99af-60d6-4cad-8d86-0cb03d53df8d service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.673537 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-83c252c5-f14a-47c2-90bb-9c46d5346ed5 req-fd0f99af-60d6-4cad-8d86-0cb03d53df8d service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.688498 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-83c252c5-f14a-47c2-90bb-9c46d5346ed5 req-fd0f99af-60d6-4cad-8d86-0cb03d53df8d service nova] Creating event network-vif-plugged:063ebb17-b759-41b1-bb29-1214343746a1 for instance b883c80f-57dd-43cb-a44e-72b33a2128e9 on hv-cinder-85001 Jul 18 02:35:50.694661 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5d7448de-0327-4157-b7ae-b131d6d3904a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:50.698306 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-83c252c5-f14a-47c2-90bb-9c46d5346ed5 req-fd0f99af-60d6-4cad-8d86-0cb03d53df8d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044325 Jul 18 02:35:50.699022 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 63/139] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:50.703089 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5d7448de-0327-4157-b7ae-b131d6d3904a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1549 microversion: 2.1 time: 0.286349 Jul 18 02:35:50.703924 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 77/140] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:50 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1549 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:50.723221 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-dbc10a50-f095-47d7-83f9-cb91ca89dab1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:50.724196 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-dbc10a50-f095-47d7-83f9-cb91ca89dab1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:50.730601 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dbc10a50-f095-47d7-83f9-cb91ca89dab1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.731054 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dbc10a50-f095-47d7-83f9-cb91ca89dab1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.731814 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dbc10a50-f095-47d7-83f9-cb91ca89dab1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:50.732248 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dbc10a50-f095-47d7-83f9-cb91ca89dab1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:50.865089 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-dbc10a50-f095-47d7-83f9-cb91ca89dab1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146012 Jul 18 02:35:50.865855 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 64/141] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 18 02:35:50 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:51.055696 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-02076573-ad79-40a8-aeca-7609cf381a52 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:51.055696 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-02076573-ad79-40a8-aeca-7609cf381a52 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:51.064035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-02076573-ad79-40a8-aeca-7609cf381a52 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:51.067506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-02076573-ad79-40a8-aeca-7609cf381a52 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:51.068430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-02076573-ad79-40a8-aeca-7609cf381a52 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:51.069199 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-02076573-ad79-40a8-aeca-7609cf381a52 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:51.248335 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-02076573-ad79-40a8-aeca-7609cf381a52 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:51.256349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-02076573-ad79-40a8-aeca-7609cf381a52 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:51.257994 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-02076573-ad79-40a8-aeca-7609cf381a52 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:51.259153 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-02076573-ad79-40a8-aeca-7609cf381a52 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.210751 Jul 18 02:35:51.259715 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 78/142] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:51 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:51.373492 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cbba4012-5161-408d-b781-2f0f5efd06c6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:51.374387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cbba4012-5161-408d-b781-2f0f5efd06c6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:51.386564 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cbba4012-5161-408d-b781-2f0f5efd06c6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:51.387020 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cbba4012-5161-408d-b781-2f0f5efd06c6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:51.387800 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cbba4012-5161-408d-b781-2f0f5efd06c6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:51.388238 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cbba4012-5161-408d-b781-2f0f5efd06c6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:51.658427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-77774d30-29c4-418e-bd55-6210e92fc560 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:51.659036 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-77774d30-29c4-418e-bd55-6210e92fc560 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:51.665413 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-77774d30-29c4-418e-bd55-6210e92fc560 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:51.665856 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-77774d30-29c4-418e-bd55-6210e92fc560 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:51.667651 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-77774d30-29c4-418e-bd55-6210e92fc560 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:51.668085 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-77774d30-29c4-418e-bd55-6210e92fc560 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:51.856208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-77774d30-29c4-418e-bd55-6210e92fc560 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:51.864588 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-77774d30-29c4-418e-bd55-6210e92fc560 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.210364 Jul 18 02:35:51.865426 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 79/143] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:51 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:51.949767 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cbba4012-5161-408d-b781-2f0f5efd06c6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:51.957206 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cbba4012-5161-408d-b781-2f0f5efd06c6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1502 microversion: 2.1 time: 0.588363 Jul 18 02:35:51.957772 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 65/144] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:51 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1502 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:52.276728 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7959bc00-6ad3-4caa-ad03-5b14143199d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:52.277342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7959bc00-6ad3-4caa-ad03-5b14143199d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:52.284909 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7959bc00-6ad3-4caa-ad03-5b14143199d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:52.285757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7959bc00-6ad3-4caa-ad03-5b14143199d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:52.286817 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7959bc00-6ad3-4caa-ad03-5b14143199d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:52.287406 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7959bc00-6ad3-4caa-ad03-5b14143199d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:52.426743 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7959bc00-6ad3-4caa-ad03-5b14143199d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:52.436299 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7959bc00-6ad3-4caa-ad03-5b14143199d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:52.438028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7959bc00-6ad3-4caa-ad03-5b14143199d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:52.439484 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7959bc00-6ad3-4caa-ad03-5b14143199d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.166716 Jul 18 02:35:52.440506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 80/145] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:52 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:52.490264 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-ef069cf9-08d2-4953-b7dd-e6a356b49a36 req-ec1d2011-39ab-42ac-ac1f-e3e921c0aca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1905a0-2c49-40f1-921a-0fda9997cdb3", "tag": "f7b04923-0911-4df9-b770-512e41d840f9"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:52.499279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-ef069cf9-08d2-4953-b7dd-e6a356b49a36 req-ec1d2011-39ab-42ac-ac1f-e3e921c0aca8 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:52.499722 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-ef069cf9-08d2-4953-b7dd-e6a356b49a36 req-ec1d2011-39ab-42ac-ac1f-e3e921c0aca8 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:52.514811 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-ef069cf9-08d2-4953-b7dd-e6a356b49a36 req-ec1d2011-39ab-42ac-ac1f-e3e921c0aca8 service nova] Creating event network-changed:f7b04923-0911-4df9-b770-512e41d840f9 for instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 on hv-cinder-85001 Jul 18 02:35:52.525646 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-ef069cf9-08d2-4953-b7dd-e6a356b49a36 req-ec1d2011-39ab-42ac-ac1f-e3e921c0aca8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039016 Jul 18 02:35:52.526724 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 66/146] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:52.726599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-cd848c69-81ed-4fd3-a383-f65493536d2f req-219a5e00-b16a-4bf0-8a70-f5a2ec8d7568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d974b9-4abf-4d7f-bbea-08e8fef381dd", "name": "network-vif-plugged", "status": "completed", "tag": "3185ab6e-a508-4ad1-b269-07229430860b"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:52.734373 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-cd848c69-81ed-4fd3-a383-f65493536d2f req-219a5e00-b16a-4bf0-8a70-f5a2ec8d7568 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:52.739728 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-cd848c69-81ed-4fd3-a383-f65493536d2f req-219a5e00-b16a-4bf0-8a70-f5a2ec8d7568 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:52.754753 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-cd848c69-81ed-4fd3-a383-f65493536d2f req-219a5e00-b16a-4bf0-8a70-f5a2ec8d7568 service nova] Creating event network-vif-plugged:3185ab6e-a508-4ad1-b269-07229430860b for instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd on hv-cinder-85001 Jul 18 02:35:52.760676 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-cd848c69-81ed-4fd3-a383-f65493536d2f req-219a5e00-b16a-4bf0-8a70-f5a2ec8d7568 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040474 Jul 18 02:35:52.761686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 81/147] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:52.883390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-da116269-4f42-4a6d-b80a-9179d0190ed3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:52.884101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-da116269-4f42-4a6d-b80a-9179d0190ed3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:52.902237 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da116269-4f42-4a6d-b80a-9179d0190ed3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:52.902694 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da116269-4f42-4a6d-b80a-9179d0190ed3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:52.918949 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da116269-4f42-4a6d-b80a-9179d0190ed3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:52.919605 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da116269-4f42-4a6d-b80a-9179d0190ed3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:53.144849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-da116269-4f42-4a6d-b80a-9179d0190ed3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.157257 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-da116269-4f42-4a6d-b80a-9179d0190ed3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1367 microversion: 2.1 time: 0.278192 Jul 18 02:35:53.159947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 67/148] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:52 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:35:53.458170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0f0c3fe8-8235-4644-881a-387885cc8a73 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:53.459587 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0f0c3fe8-8235-4644-881a-387885cc8a73 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:53.468681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0f0c3fe8-8235-4644-881a-387885cc8a73 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:53.473451 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0f0c3fe8-8235-4644-881a-387885cc8a73 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:53.473451 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0f0c3fe8-8235-4644-881a-387885cc8a73 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:53.473451 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0f0c3fe8-8235-4644-881a-387885cc8a73 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:53.795094 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0f0c3fe8-8235-4644-881a-387885cc8a73 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.808826 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0f0c3fe8-8235-4644-881a-387885cc8a73 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.812828 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0f0c3fe8-8235-4644-881a-387885cc8a73 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:53.814223 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0f0c3fe8-8235-4644-881a-387885cc8a73 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.361025 Jul 18 02:35:53.827308 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 82/149] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:53 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:53.852322 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2bdb54ca-eab4-442a-9169-ad5d18f9839c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8656e4f-d50e-4b3f-8e1b-c4a8f9e7ddaf"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:53.855742 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2bdb54ca-eab4-442a-9169-ad5d18f9839c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:53.860470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bdb54ca-eab4-442a-9169-ad5d18f9839c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:53.860911 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bdb54ca-eab4-442a-9169-ad5d18f9839c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:53.861705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bdb54ca-eab4-442a-9169-ad5d18f9839c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:53.862173 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bdb54ca-eab4-442a-9169-ad5d18f9839c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.178497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3d23a294-27e9-4d08-8855-66af61c8970c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:54.179725 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3d23a294-27e9-4d08-8855-66af61c8970c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:54.187592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3d23a294-27e9-4d08-8855-66af61c8970c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.188302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3d23a294-27e9-4d08-8855-66af61c8970c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.189081 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3d23a294-27e9-4d08-8855-66af61c8970c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.189516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3d23a294-27e9-4d08-8855-66af61c8970c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.329244 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3d23a294-27e9-4d08-8855-66af61c8970c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:54.337056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3d23a294-27e9-4d08-8855-66af61c8970c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1557 microversion: 2.1 time: 0.164098 Jul 18 02:35:54.338591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 83/150] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:35:54 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:35:54.355478 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3e5d4ee7-37e6-4d71-ba03-45493979fae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:54.356184 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3e5d4ee7-37e6-4d71-ba03-45493979fae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:54.362424 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3e5d4ee7-37e6-4d71-ba03-45493979fae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.362930 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3e5d4ee7-37e6-4d71-ba03-45493979fae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.363699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3e5d4ee7-37e6-4d71-ba03-45493979fae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.369846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3e5d4ee7-37e6-4d71-ba03-45493979fae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.527030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3e5d4ee7-37e6-4d71-ba03-45493979fae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176045 Jul 18 02:35:54.537339 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 84/151] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 18 02:35:54 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:54.835807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d2867feb-8282-4d93-98f0-19de0fc8887e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:54.836871 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d2867feb-8282-4d93-98f0-19de0fc8887e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:54.845083 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d2867feb-8282-4d93-98f0-19de0fc8887e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.845787 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d2867feb-8282-4d93-98f0-19de0fc8887e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:54.846743 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d2867feb-8282-4d93-98f0-19de0fc8887e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:54.847333 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d2867feb-8282-4d93-98f0-19de0fc8887e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:55.151878 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d2867feb-8282-4d93-98f0-19de0fc8887e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.167885 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d2867feb-8282-4d93-98f0-19de0fc8887e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.172175 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d2867feb-8282-4d93-98f0-19de0fc8887e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:55.174041 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d2867feb-8282-4d93-98f0-19de0fc8887e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1407 microversion: 2.20 time: 0.344623 Jul 18 02:35:55.175176 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 85/152] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:54 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:35:55.222436 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2bdb54ca-eab4-442a-9169-ad5d18f9839c tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "POST /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.373566 Jul 18 02:35:55.223781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 68/153] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:35:53 2022] POST /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762/os-volume_attachments => generated 194 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:35:55.813338 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-b6599842-7be5-4e45-8bb4-1a8d194dd4f5 req-38ba70d0-aaf4-4e78-9c7c-6c9099f8aab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b883c80f-57dd-43cb-a44e-72b33a2128e9", "tag": "063ebb17-b759-41b1-bb29-1214343746a1"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:55.822312 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-b6599842-7be5-4e45-8bb4-1a8d194dd4f5 req-38ba70d0-aaf4-4e78-9c7c-6c9099f8aab7 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:55.823028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-b6599842-7be5-4e45-8bb4-1a8d194dd4f5 req-38ba70d0-aaf4-4e78-9c7c-6c9099f8aab7 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:55.834117 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-b6599842-7be5-4e45-8bb4-1a8d194dd4f5 req-38ba70d0-aaf4-4e78-9c7c-6c9099f8aab7 service nova] Creating event network-changed:063ebb17-b759-41b1-bb29-1214343746a1 for instance b883c80f-57dd-43cb-a44e-72b33a2128e9 on hv-cinder-85001 Jul 18 02:35:55.839741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-b6599842-7be5-4e45-8bb4-1a8d194dd4f5 req-38ba70d0-aaf4-4e78-9c7c-6c9099f8aab7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031221 Jul 18 02:35:55.840336 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 86/154] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:35:56.193628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-80dcc982-3e07-4c99-969f-a6ffe51e12b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:56.197784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-80dcc982-3e07-4c99-969f-a6ffe51e12b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:56.205720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-80dcc982-3e07-4c99-969f-a6ffe51e12b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.206845 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-80dcc982-3e07-4c99-969f-a6ffe51e12b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.207755 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-80dcc982-3e07-4c99-969f-a6ffe51e12b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.208320 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-80dcc982-3e07-4c99-969f-a6ffe51e12b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.462004 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-80dcc982-3e07-4c99-969f-a6ffe51e12b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:56.477523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-80dcc982-3e07-4c99-969f-a6ffe51e12b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:56.480680 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-80dcc982-3e07-4c99-969f-a6ffe51e12b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:35:56.481999 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-80dcc982-3e07-4c99-969f-a6ffe51e12b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1599 microversion: 2.20 time: 0.292697 Jul 18 02:35:56.482747 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 69/155] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:35:56 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1599 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:35:56.504068 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4ad8353a-fea5-4323-a86f-ff6f105b0cf2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:35:56.504654 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4ad8353a-fea5-4323-a86f-ff6f105b0cf2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:35:56.511368 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4ad8353a-fea5-4323-a86f-ff6f105b0cf2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.512071 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4ad8353a-fea5-4323-a86f-ff6f105b0cf2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.513033 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4ad8353a-fea5-4323-a86f-ff6f105b0cf2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:56.513653 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4ad8353a-fea5-4323-a86f-ff6f105b0cf2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:56.694679 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4ad8353a-fea5-4323-a86f-ff6f105b0cf2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.194807 Jul 18 02:35:56.696928 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 87/156] 10.222.0.66 () {60 vars in 1315 bytes} [Mon Jul 18 02:35:56 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:35:58.012770 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-c735c8c4-0c03-460f-a3db-6200bdc976a0 req-a80197fb-f7b0-4d74-80a6-20d4ac8d16db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d974b9-4abf-4d7f-bbea-08e8fef381dd", "tag": "3185ab6e-a508-4ad1-b269-07229430860b"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:35:58.022341 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-c735c8c4-0c03-460f-a3db-6200bdc976a0 req-a80197fb-f7b0-4d74-80a6-20d4ac8d16db service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:35:58.022793 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-c735c8c4-0c03-460f-a3db-6200bdc976a0 req-a80197fb-f7b0-4d74-80a6-20d4ac8d16db service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:35:58.036732 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-c735c8c4-0c03-460f-a3db-6200bdc976a0 req-a80197fb-f7b0-4d74-80a6-20d4ac8d16db service nova] Creating event network-changed:3185ab6e-a508-4ad1-b269-07229430860b for instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd on hv-cinder-85001 Jul 18 02:35:58.050413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-c735c8c4-0c03-460f-a3db-6200bdc976a0 req-a80197fb-f7b0-4d74-80a6-20d4ac8d16db service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038349 Jul 18 02:35:58.050413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 70/157] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:06.613482 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:06.617177 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=60 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:06.617177 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=84 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:06.619901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-acebedf3-822c-4d63-9515-66e594dc6ee3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:06.620409 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-acebedf3-822c-4d63-9515-66e594dc6ee3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:06.634179 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-acebedf3-822c-4d63-9515-66e594dc6ee3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:06.635275 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-acebedf3-822c-4d63-9515-66e594dc6ee3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:06.636320 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-acebedf3-822c-4d63-9515-66e594dc6ee3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:06.636956 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-acebedf3-822c-4d63-9515-66e594dc6ee3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:06.665831 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-acebedf3-822c-4d63-9515-66e594dc6ee3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:36:07.208905 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-acebedf3-822c-4d63-9515-66e594dc6ee3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 204 len: 0 microversion: 2.1 time: 0.595866 Jul 18 02:36:07.209571 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 88/158] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:36:06 2022] DELETE /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:36:07.219843 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-750c4d1b-9aae-455b-8d72-ab0e899a43f8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:07.221216 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-750c4d1b-9aae-455b-8d72-ab0e899a43f8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:07.228248 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=73 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:07.229043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-750c4d1b-9aae-455b-8d72-ab0e899a43f8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:07.229501 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-750c4d1b-9aae-455b-8d72-ab0e899a43f8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:07.230312 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-750c4d1b-9aae-455b-8d72-ab0e899a43f8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:07.230768 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-750c4d1b-9aae-455b-8d72-ab0e899a43f8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:07.394545 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-750c4d1b-9aae-455b-8d72-ab0e899a43f8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:07.407591 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-750c4d1b-9aae-455b-8d72-ab0e899a43f8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1554 microversion: 2.1 time: 0.193203 Jul 18 02:36:07.408524 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 71/159] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:07 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:08.427097 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4559a688-b772-4686-b726-dda17237be7a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:08.427765 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4559a688-b772-4686-b726-dda17237be7a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:08.435181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4559a688-b772-4686-b726-dda17237be7a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:08.435626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4559a688-b772-4686-b726-dda17237be7a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:08.436374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4559a688-b772-4686-b726-dda17237be7a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:08.436854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4559a688-b772-4686-b726-dda17237be7a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:08.573195 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4559a688-b772-4686-b726-dda17237be7a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:08.581345 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4559a688-b772-4686-b726-dda17237be7a tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1554 microversion: 2.1 time: 0.159059 Jul 18 02:36:08.582662 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 89/160] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:08 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:09.605083 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a4cac5cd-75c3-4f5b-8dbc-e2a0216c06a6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:09.606414 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a4cac5cd-75c3-4f5b-8dbc-e2a0216c06a6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:09.620938 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4cac5cd-75c3-4f5b-8dbc-e2a0216c06a6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.621390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4cac5cd-75c3-4f5b-8dbc-e2a0216c06a6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.622189 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4cac5cd-75c3-4f5b-8dbc-e2a0216c06a6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:09.622632 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4cac5cd-75c3-4f5b-8dbc-e2a0216c06a6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:09.780098 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a4cac5cd-75c3-4f5b-8dbc-e2a0216c06a6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:09.789134 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a4cac5cd-75c3-4f5b-8dbc-e2a0216c06a6 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1554 microversion: 2.1 time: 0.194936 Jul 18 02:36:09.790637 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 72/161] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:09 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:10.808840 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3be3e149-6e48-4d45-86a4-cbfe7d549783 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:10.808840 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3be3e149-6e48-4d45-86a4-cbfe7d549783 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:10.814226 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3be3e149-6e48-4d45-86a4-cbfe7d549783 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:10.814677 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3be3e149-6e48-4d45-86a4-cbfe7d549783 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:10.815444 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3be3e149-6e48-4d45-86a4-cbfe7d549783 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:10.815884 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3be3e149-6e48-4d45-86a4-cbfe7d549783 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:10.947077 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3be3e149-6e48-4d45-86a4-cbfe7d549783 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:10.955660 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3be3e149-6e48-4d45-86a4-cbfe7d549783 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1554 microversion: 2.1 time: 0.152540 Jul 18 02:36:10.956235 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 90/162] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:10 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:11.973042 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0d9ef753-2fc0-4c9f-b98a-c6e62cac7c7b tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:11.973719 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0d9ef753-2fc0-4c9f-b98a-c6e62cac7c7b tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:11.981013 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0d9ef753-2fc0-4c9f-b98a-c6e62cac7c7b tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.981232 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0d9ef753-2fc0-4c9f-b98a-c6e62cac7c7b tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:11.982011 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0d9ef753-2fc0-4c9f-b98a-c6e62cac7c7b tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:11.982479 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0d9ef753-2fc0-4c9f-b98a-c6e62cac7c7b tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:12.123236 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0d9ef753-2fc0-4c9f-b98a-c6e62cac7c7b tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:12.131346 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0d9ef753-2fc0-4c9f-b98a-c6e62cac7c7b tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1554 microversion: 2.1 time: 0.162230 Jul 18 02:36:12.131988 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 73/163] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:11 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:13.149974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f79e5334-b0d2-4312-bab9-8000cd14cc69 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:13.150634 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f79e5334-b0d2-4312-bab9-8000cd14cc69 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:13.156875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f79e5334-b0d2-4312-bab9-8000cd14cc69 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:13.157330 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f79e5334-b0d2-4312-bab9-8000cd14cc69 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:13.158122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f79e5334-b0d2-4312-bab9-8000cd14cc69 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:13.158565 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f79e5334-b0d2-4312-bab9-8000cd14cc69 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:13.329589 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f79e5334-b0d2-4312-bab9-8000cd14cc69 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:13.338904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f79e5334-b0d2-4312-bab9-8000cd14cc69 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1554 microversion: 2.1 time: 0.193515 Jul 18 02:36:13.339488 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 91/164] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:13 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:14.203973 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-72cd21a2-f4ee-4b33-becb-7239c37e9b3c req-b1c51157-0353-4327-aae0-61a5df55852b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0900bee1-a6cb-431f-9596-b1f13f8e8762", "name": "network-vif-deleted", "tag": "b96e2133-e507-43d3-98e8-30f0e0715209"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:14.214368 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-72cd21a2-f4ee-4b33-becb-7239c37e9b3c req-b1c51157-0353-4327-aae0-61a5df55852b service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:14.214821 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-72cd21a2-f4ee-4b33-becb-7239c37e9b3c req-b1c51157-0353-4327-aae0-61a5df55852b service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:14.226235 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-72cd21a2-f4ee-4b33-becb-7239c37e9b3c req-b1c51157-0353-4327-aae0-61a5df55852b service nova] Creating event network-vif-deleted:b96e2133-e507-43d3-98e8-30f0e0715209 for instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 on hv-cinder-85001 Jul 18 02:36:14.231344 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-72cd21a2-f4ee-4b33-becb-7239c37e9b3c req-b1c51157-0353-4327-aae0-61a5df55852b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031107 Jul 18 02:36:14.231935 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 74/165] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:14.356721 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ed06b170-07ea-4ff7-a614-2f88c5c6d3ec tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:14.357336 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ed06b170-07ea-4ff7-a614-2f88c5c6d3ec tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:14.363540 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ed06b170-07ea-4ff7-a614-2f88c5c6d3ec tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:14.364084 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ed06b170-07ea-4ff7-a614-2f88c5c6d3ec tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:14.364785 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ed06b170-07ea-4ff7-a614-2f88c5c6d3ec tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:14.365228 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ed06b170-07ea-4ff7-a614-2f88c5c6d3ec tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:14.431842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ed06b170-07ea-4ff7-a614-2f88c5c6d3ec tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:14.439742 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ed06b170-07ea-4ff7-a614-2f88c5c6d3ec tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1512 microversion: 2.1 time: 0.087442 Jul 18 02:36:14.440317 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 92/166] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:14 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1512 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:15.463947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:15.464679 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:15.480194 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:15.480648 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:15.481428 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:15.481858 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:15.516620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:15.517283 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:15.517759 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lazy-loading 'fault' on Instance uuid 0900bee1-a6cb-431f-9596-b1f13f8e8762 {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:36:15.593518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f6e1501362435d8485ac5eb4b9f315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0695b3617d845118c00ba7cff6d312a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:15.593518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:15.598157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-677ea33f-fd78-4802-a79c-c657f9d67533 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 200 len: 1351 microversion: 2.1 time: 0.145076 Jul 18 02:36:15.598737 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 75/167] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:15 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 1351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:16.615302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7143ca13-1d69-4b7a-b3b9-cd38d9333cf8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:16.615912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7143ca13-1d69-4b7a-b3b9-cd38d9333cf8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:16.625181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7143ca13-1d69-4b7a-b3b9-cd38d9333cf8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:16.625181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7143ca13-1d69-4b7a-b3b9-cd38d9333cf8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:16.625181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7143ca13-1d69-4b7a-b3b9-cd38d9333cf8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:16.625181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7143ca13-1d69-4b7a-b3b9-cd38d9333cf8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:16.640715 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-7143ca13-1d69-4b7a-b3b9-cd38d9333cf8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] HTTP exception thrown: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7143ca13-1d69-4b7a-b3b9-cd38d9333cf8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Request method failure captured: Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 HTTP/1.1 Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1Mbff9BScU8B_rMaZiKWLh2V0RFviOYMtEIQnxgH8DyJcWgbwA4CYSFtaUlNkoAkfOUhqZQjfrDr_kDx-AfOt7cWmdFWpy4xUV0g8FdVynCNcyCK1wyr5y9WCXvDsBKfNcvAn4daPbHCOHnraEl8rLkplMU-2XBhHeVLMTATWbAbUZc Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: d0695b3617d845118c00ba7cff6d312a Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:36:16.645559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d0695b3617d845118c00ba7cff6d312a", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: d0695b3617d845118c00ba7cff6d312a Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-DeleteServersTestJSON-917308903-project Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 39f6e1501362435d8485ac5eb4b9f315 Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-DeleteServersTestJSON-917308903-project Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:16.646904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '0900bee1-a6cb-431f-9596-b1f13f8e8762'} Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:16.647646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:16.648846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:36:16.649853 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7143ca13-1d69-4b7a-b3b9-cd38d9333cf8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Returning 404 to user: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:16.649853 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7143ca13-1d69-4b7a-b3b9-cd38d9333cf8 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 404 len: 111 microversion: 2.1 time: 0.035520 Jul 18 02:36:16.649853 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 93/168] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:16 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:16.752323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ad74fe80-abb4-4b30-9c87-03eece545bd3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:16.753373 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-ad74fe80-abb4-4b30-9c87-03eece545bd3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:16.761690 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ad74fe80-abb4-4b30-9c87-03eece545bd3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:16.762329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ad74fe80-abb4-4b30-9c87-03eece545bd3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:16.763281 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ad74fe80-abb4-4b30-9c87-03eece545bd3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:16.763920 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ad74fe80-abb4-4b30-9c87-03eece545bd3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:16.779476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-ad74fe80-abb4-4b30-9c87-03eece545bd3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] HTTP exception thrown: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ad74fe80-abb4-4b30-9c87-03eece545bd3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Request method failure captured: Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762/os-volume_attachments HTTP/1.1 Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1Mbff9BScU8B_rMaZiKWLh2V0RFviOYMtEIQnxgH8DyJcWgbwA4CYSFtaUlNkoAkfOUhqZQjfrDr_kDx-AfOt7cWmdFWpy4xUV0g8FdVynCNcyCK1wyr5y9WCXvDsBKfNcvAn4daPbHCOHnraEl8rLkplMU-2XBhHeVLMTATWbAbUZc Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: d0695b3617d845118c00ba7cff6d312a Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:36:16.792015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d0695b3617d845118c00ba7cff6d312a", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: d0695b3617d845118c00ba7cff6d312a Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-DeleteServersTestJSON-917308903-project Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 39f6e1501362435d8485ac5eb4b9f315 Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-DeleteServersTestJSON-917308903-project Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:16.793526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'server_id': '0900bee1-a6cb-431f-9596-b1f13f8e8762'} Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:16.794266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:16.795342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:36:16.796985 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ad74fe80-abb4-4b30-9c87-03eece545bd3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Returning 404 to user: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:16.796985 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ad74fe80-abb4-4b30-9c87-03eece545bd3 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037012 Jul 18 02:36:16.796985 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 76/169] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:36:16 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:18.189501 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3cb38dbb-4b37-4e13-aca4-9ad2251f42a5 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:18.190004 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3cb38dbb-4b37-4e13-aca4-9ad2251f42a5 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:18.196694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3cb38dbb-4b37-4e13-aca4-9ad2251f42a5 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.197169 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3cb38dbb-4b37-4e13-aca4-9ad2251f42a5 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:18.198714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3cb38dbb-4b37-4e13-aca4-9ad2251f42a5 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.203006 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3cb38dbb-4b37-4e13-aca4-9ad2251f42a5 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:18.214158 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-3cb38dbb-4b37-4e13-aca4-9ad2251f42a5 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] HTTP exception thrown: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3cb38dbb-4b37-4e13-aca4-9ad2251f42a5 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Request method failure captured: Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: DELETE /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 HTTP/1.1 Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1Mbff9BScU8B_rMaZiKWLh2V0RFviOYMtEIQnxgH8DyJcWgbwA4CYSFtaUlNkoAkfOUhqZQjfrDr_kDx-AfOt7cWmdFWpy4xUV0g8FdVynCNcyCK1wyr5y9WCXvDsBKfNcvAn4daPbHCOHnraEl8rLkplMU-2XBhHeVLMTATWbAbUZc Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: d0695b3617d845118c00ba7cff6d312a Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:36:18.215671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d0695b3617d845118c00ba7cff6d312a", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: d0695b3617d845118c00ba7cff6d312a Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-DeleteServersTestJSON-917308903-project Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 39f6e1501362435d8485ac5eb4b9f315 Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-DeleteServersTestJSON-917308903-project Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:18.217030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '0900bee1-a6cb-431f-9596-b1f13f8e8762'} Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:18.217714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:18.218842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.219943 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3cb38dbb-4b37-4e13-aca4-9ad2251f42a5 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Returning 404 to user: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:18.219943 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3cb38dbb-4b37-4e13-aca4-9ad2251f42a5 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 404 len: 111 microversion: 2.1 time: 0.031486 Jul 18 02:36:18.219943 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 94/170] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:36:18 2022] DELETE /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:18.225760 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-425d0b7b-df5c-45f2-a58a-ef88e5eefb97 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:18.227139 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-425d0b7b-df5c-45f2-a58a-ef88e5eefb97 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] [instance: 0900bee1-a6cb-431f-9596-b1f13f8e8762] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:18.233972 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-425d0b7b-df5c-45f2-a58a-ef88e5eefb97 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.234479 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-425d0b7b-df5c-45f2-a58a-ef88e5eefb97 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:18.235231 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-425d0b7b-df5c-45f2-a58a-ef88e5eefb97 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:18.235658 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-425d0b7b-df5c-45f2-a58a-ef88e5eefb97 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:18.248852 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-425d0b7b-df5c-45f2-a58a-ef88e5eefb97 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] HTTP exception thrown: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-425d0b7b-df5c-45f2-a58a-ef88e5eefb97 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Request method failure captured: Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 HTTP/1.1 Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1Mbff9BScU8B_rMaZiKWLh2V0RFviOYMtEIQnxgH8DyJcWgbwA4CYSFtaUlNkoAkfOUhqZQjfrDr_kDx-AfOt7cWmdFWpy4xUV0g8FdVynCNcyCK1wyr5y9WCXvDsBKfNcvAn4daPbHCOHnraEl8rLkplMU-2XBhHeVLMTATWbAbUZc Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: d0695b3617d845118c00ba7cff6d312a Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:36:18.250992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d0695b3617d845118c00ba7cff6d312a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d0695b3617d845118c00ba7cff6d312a", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: d0695b3617d845118c00ba7cff6d312a Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-DeleteServersTestJSON-917308903 Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-DeleteServersTestJSON-917308903-project Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 39f6e1501362435d8485ac5eb4b9f315 Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-DeleteServersTestJSON-917308903-project Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:18.252450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '0900bee1-a6cb-431f-9596-b1f13f8e8762'} Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:36:18.253265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. Jul 18 02:36:18.254639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:36:18.255852 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-425d0b7b-df5c-45f2-a58a-ef88e5eefb97 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] Returning 404 to user: Instance 0900bee1-a6cb-431f-9596-b1f13f8e8762 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:36:18.255852 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-425d0b7b-df5c-45f2-a58a-ef88e5eefb97 tempest-DeleteServersTestJSON-917308903 tempest-DeleteServersTestJSON-917308903-project] 10.222.0.66 "GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762" status: 404 len: 111 microversion: 2.1 time: 0.030698 Jul 18 02:36:18.255852 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 77/171] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:18 2022] GET /compute/v2.1/servers/0900bee1-a6cb-431f-9596-b1f13f8e8762 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:36:30.607956 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:30.609094 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:30.740665 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-217019778", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:30.795970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] validate_networks() for [('9e66762c-c4d2-46f6-ba12-585a390bb14c', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:36:31.222285 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:31.222708 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:31.223178 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:31.223612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:31.224019 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:31.233887 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:31.234365 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:31.235160 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:31.235591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:31.254258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Getting quotas for project 9ec4c1c1687944b98c1c5cefe05df095. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:36:31.258321 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Getting quotas for user d281c92e20d04004a679a8ec65f9e6d5 and project 9ec4c1c1687944b98c1c5cefe05df095. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:36:31.271019 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:36:31.273719 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:36:31.436213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-30378a1b-8b4a-4af0-968e-d38f5bbcaf1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.833987 Jul 18 02:36:31.436866 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 95/172] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:36:31.448172 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-77fe1c24-534e-4c4c-9fa9-aab496e7f0e0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:31.451677 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-77fe1c24-534e-4c4c-9fa9-aab496e7f0e0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:31.451677 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=15 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:31.515495 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-77fe1c24-534e-4c4c-9fa9-aab496e7f0e0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:31.523598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-77fe1c24-534e-4c4c-9fa9-aab496e7f0e0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1221 microversion: 2.1 time: 0.080460 Jul 18 02:36:31.530731 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 78/173] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:31 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:31.591131 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-544079636", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:31.673128 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] validate_networks() for [('9e66762c-c4d2-46f6-ba12-585a390bb14c', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:36:32.296802 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:32.297305 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:32.297775 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:32.298206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:32.298615 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:32.307495 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:32.308131 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:32.324088 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:32.324088 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:32.333558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Getting quotas for project 9ec4c1c1687944b98c1c5cefe05df095. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:36:32.338647 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Getting quotas for user d281c92e20d04004a679a8ec65f9e6d5 and project 9ec4c1c1687944b98c1c5cefe05df095. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:36:32.350069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:36:32.352577 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:36:32.451203 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9641ca1c-61b7-4b15-bde7-10cc08b04166 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.871074 Jul 18 02:36:32.452403 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 96/174] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:36:32.468732 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-92f0766f-d54f-40a5-b5a1-9875183a4bf7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:32.470960 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-92f0766f-d54f-40a5-b5a1-9875183a4bf7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:32.559575 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-92f0766f-d54f-40a5-b5a1-9875183a4bf7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:32.566222 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-92f0766f-d54f-40a5-b5a1-9875183a4bf7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1221 microversion: 2.1 time: 0.107765 Jul 18 02:36:32.566872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 79/175] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:32 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1221 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:33.585253 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d28dd96a-5547-4989-9e37-d3c3e2fe3344 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:33.585871 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d28dd96a-5547-4989-9e37-d3c3e2fe3344 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:33.604105 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d28dd96a-5547-4989-9e37-d3c3e2fe3344 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:33.608708 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d28dd96a-5547-4989-9e37-d3c3e2fe3344 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:33.608708 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d28dd96a-5547-4989-9e37-d3c3e2fe3344 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:33.608708 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d28dd96a-5547-4989-9e37-d3c3e2fe3344 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:33.712530 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d28dd96a-5547-4989-9e37-d3c3e2fe3344 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:33.721634 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d28dd96a-5547-4989-9e37-d3c3e2fe3344 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1225 microversion: 2.1 time: 0.140538 Jul 18 02:36:33.737173 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 97/176] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:33 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:34.742692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1c8450e9-f4fe-452e-a84f-5516e0008a44 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:34.743306 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1c8450e9-f4fe-452e-a84f-5516e0008a44 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:34.751449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c8450e9-f4fe-452e-a84f-5516e0008a44 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.751901 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c8450e9-f4fe-452e-a84f-5516e0008a44 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.752672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c8450e9-f4fe-452e-a84f-5516e0008a44 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:34.753112 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c8450e9-f4fe-452e-a84f-5516e0008a44 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:34.820588 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1c8450e9-f4fe-452e-a84f-5516e0008a44 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:34.829005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1c8450e9-f4fe-452e-a84f-5516e0008a44 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1273 microversion: 2.1 time: 0.090313 Jul 18 02:36:34.829578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 80/177] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:34 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:35.848652 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4859df9e-ddd7-4d99-bbea-251df2c081a7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:35.850761 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4859df9e-ddd7-4d99-bbea-251df2c081a7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:35.860409 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4859df9e-ddd7-4d99-bbea-251df2c081a7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.860907 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4859df9e-ddd7-4d99-bbea-251df2c081a7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.861691 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4859df9e-ddd7-4d99-bbea-251df2c081a7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:35.862157 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4859df9e-ddd7-4d99-bbea-251df2c081a7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:35.945071 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4859df9e-ddd7-4d99-bbea-251df2c081a7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:35.953362 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4859df9e-ddd7-4d99-bbea-251df2c081a7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1279 microversion: 2.1 time: 0.110328 Jul 18 02:36:35.954293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 98/178] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:35 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1279 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:36.974865 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-94883b19-38a2-47a3-9093-fd57568cd5ad tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:36.975480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-94883b19-38a2-47a3-9093-fd57568cd5ad tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:36.981820 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94883b19-38a2-47a3-9093-fd57568cd5ad tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.982307 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94883b19-38a2-47a3-9093-fd57568cd5ad tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:36.983073 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94883b19-38a2-47a3-9093-fd57568cd5ad tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:36.983509 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94883b19-38a2-47a3-9093-fd57568cd5ad tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:37.117431 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-c46efa4d-bd36-4aa1-a2ae-bca8611156fa req-c4def872-5923-43ab-885c-cc561419385f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f7f8048-6316-49a6-89a0-2b5113d7d9f8", "tag": "caf2e138-8e60-4fcf-8119-71c69a88ae7d"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:37.120978 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-94883b19-38a2-47a3-9093-fd57568cd5ad tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:37.127986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-c46efa4d-bd36-4aa1-a2ae-bca8611156fa req-c4def872-5923-43ab-885c-cc561419385f service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:37.128431 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-c46efa4d-bd36-4aa1-a2ae-bca8611156fa req-c4def872-5923-43ab-885c-cc561419385f service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:37.129544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-94883b19-38a2-47a3-9093-fd57568cd5ad tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.158117 Jul 18 02:36:37.130148 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 81/179] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:36 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:37.151030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-c46efa4d-bd36-4aa1-a2ae-bca8611156fa req-c4def872-5923-43ab-885c-cc561419385f service nova] Creating event network-changed:caf2e138-8e60-4fcf-8119-71c69a88ae7d for instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 on hv-cinder-85001 Jul 18 02:36:37.157470 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-c46efa4d-bd36-4aa1-a2ae-bca8611156fa req-c4def872-5923-43ab-885c-cc561419385f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045251 Jul 18 02:36:37.158079 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 99/180] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:38.147560 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0ade9375-13c9-46ae-a01b-5f370c11e718 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:38.148168 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0ade9375-13c9-46ae-a01b-5f370c11e718 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:38.155103 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0ade9375-13c9-46ae-a01b-5f370c11e718 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:38.159111 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0ade9375-13c9-46ae-a01b-5f370c11e718 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:38.159111 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0ade9375-13c9-46ae-a01b-5f370c11e718 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:38.159111 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0ade9375-13c9-46ae-a01b-5f370c11e718 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:38.285696 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0ade9375-13c9-46ae-a01b-5f370c11e718 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:38.293150 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0ade9375-13c9-46ae-a01b-5f370c11e718 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.149751 Jul 18 02:36:38.293744 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 82/181] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:38 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:39.309722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-746b5715-8dc5-41f3-85ba-5cc82579c5b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:39.310445 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-746b5715-8dc5-41f3-85ba-5cc82579c5b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:39.316533 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-746b5715-8dc5-41f3-85ba-5cc82579c5b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.316974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-746b5715-8dc5-41f3-85ba-5cc82579c5b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.317747 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-746b5715-8dc5-41f3-85ba-5cc82579c5b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:39.318189 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-746b5715-8dc5-41f3-85ba-5cc82579c5b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:39.745375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-746b5715-8dc5-41f3-85ba-5cc82579c5b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:39.752741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-746b5715-8dc5-41f3-85ba-5cc82579c5b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.447467 Jul 18 02:36:39.753307 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 100/182] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:39 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:40.770248 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7d16a7ae-14e3-45f2-8501-50399ef423bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:40.770863 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7d16a7ae-14e3-45f2-8501-50399ef423bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:40.779589 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7d16a7ae-14e3-45f2-8501-50399ef423bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:40.780050 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7d16a7ae-14e3-45f2-8501-50399ef423bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.780830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7d16a7ae-14e3-45f2-8501-50399ef423bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:40.781272 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7d16a7ae-14e3-45f2-8501-50399ef423bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.945388 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7d16a7ae-14e3-45f2-8501-50399ef423bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:40.954418 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-974e7a82-1960-44aa-95d7-7c43b104dbb9 req-ee488fd4-4df0-48a0-ad14-c3881d347fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a73b2c-9286-4682-a1d3-a1893278cead", "tag": "724ae0ef-7a5c-49c2-8a15-2a37d668dc73"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:40.955025 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7d16a7ae-14e3-45f2-8501-50399ef423bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.188457 Jul 18 02:36:40.965501 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 83/183] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:40 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:40.965618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-974e7a82-1960-44aa-95d7-7c43b104dbb9 req-ee488fd4-4df0-48a0-ad14-c3881d347fe5 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:40.965618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-974e7a82-1960-44aa-95d7-7c43b104dbb9 req-ee488fd4-4df0-48a0-ad14-c3881d347fe5 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:40.981419 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-974e7a82-1960-44aa-95d7-7c43b104dbb9 req-ee488fd4-4df0-48a0-ad14-c3881d347fe5 service nova] Creating event network-changed:724ae0ef-7a5c-49c2-8a15-2a37d668dc73 for instance 64a73b2c-9286-4682-a1d3-a1893278cead on hv-cinder-85001 Jul 18 02:36:40.987189 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-974e7a82-1960-44aa-95d7-7c43b104dbb9 req-ee488fd4-4df0-48a0-ad14-c3881d347fe5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039114 Jul 18 02:36:40.987930 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 101/184] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:41.972212 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f2bad4ec-c728-46cd-85e5-4870ffd8e20d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:41.972822 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f2bad4ec-c728-46cd-85e5-4870ffd8e20d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:41.979572 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2bad4ec-c728-46cd-85e5-4870ffd8e20d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.980025 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2bad4ec-c728-46cd-85e5-4870ffd8e20d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:41.980787 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2bad4ec-c728-46cd-85e5-4870ffd8e20d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:41.981242 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2bad4ec-c728-46cd-85e5-4870ffd8e20d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:42.114237 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f2bad4ec-c728-46cd-85e5-4870ffd8e20d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:42.121846 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f2bad4ec-c728-46cd-85e5-4870ffd8e20d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.153533 Jul 18 02:36:42.123054 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 84/185] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:41 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:43.137161 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=4 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:43.137929 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=12 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:43.142224 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0ba3e662-dbb8-4c8a-8c27-3b65c13209db tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:43.144559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0ba3e662-dbb8-4c8a-8c27-3b65c13209db tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:43.151200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ba3e662-dbb8-4c8a-8c27-3b65c13209db tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.151661 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ba3e662-dbb8-4c8a-8c27-3b65c13209db tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.152676 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ba3e662-dbb8-4c8a-8c27-3b65c13209db tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:43.152954 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ba3e662-dbb8-4c8a-8c27-3b65c13209db tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:43.305057 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0ba3e662-dbb8-4c8a-8c27-3b65c13209db tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:43.313499 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0ba3e662-dbb8-4c8a-8c27-3b65c13209db tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.177900 Jul 18 02:36:43.314271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 102/186] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:43 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:44.387946 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-711b2f10-f82a-4494-9604-07155619d453 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:44.387946 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-711b2f10-f82a-4494-9604-07155619d453 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:44.387946 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=4 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:44.387946 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-711b2f10-f82a-4494-9604-07155619d453 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.388880 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-711b2f10-f82a-4494-9604-07155619d453 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.388880 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-711b2f10-f82a-4494-9604-07155619d453 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:44.388880 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-711b2f10-f82a-4494-9604-07155619d453 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:44.490719 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-711b2f10-f82a-4494-9604-07155619d453 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:44.500124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-711b2f10-f82a-4494-9604-07155619d453 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.173141 Jul 18 02:36:44.500675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 85/187] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:44 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:36:45.525905 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fadb381c-8c53-473a-b763-b47aa2793bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:45.526553 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fadb381c-8c53-473a-b763-b47aa2793bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:45.533994 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fadb381c-8c53-473a-b763-b47aa2793bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:45.534478 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fadb381c-8c53-473a-b763-b47aa2793bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.535247 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fadb381c-8c53-473a-b763-b47aa2793bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:45.535693 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fadb381c-8c53-473a-b763-b47aa2793bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:45.663523 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fadb381c-8c53-473a-b763-b47aa2793bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:45.671670 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fadb381c-8c53-473a-b763-b47aa2793bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.149784 Jul 18 02:36:45.672233 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 103/188] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:45 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:46.689043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-86093211-782a-40e4-8999-31534a57b473 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:46.689590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-86093211-782a-40e4-8999-31534a57b473 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:46.696918 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-86093211-782a-40e4-8999-31534a57b473 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:46.697364 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-86093211-782a-40e4-8999-31534a57b473 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:46.698146 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-86093211-782a-40e4-8999-31534a57b473 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:46.698592 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-86093211-782a-40e4-8999-31534a57b473 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:47.025164 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-86093211-782a-40e4-8999-31534a57b473 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:47.034288 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-86093211-782a-40e4-8999-31534a57b473 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.348997 Jul 18 02:36:47.035084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 86/189] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:46 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:48.054441 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-97d5bd31-87ca-4460-b035-e3684c403d28 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:48.055258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-97d5bd31-87ca-4460-b035-e3684c403d28 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:48.061720 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97d5bd31-87ca-4460-b035-e3684c403d28 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:48.062332 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97d5bd31-87ca-4460-b035-e3684c403d28 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:48.063253 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97d5bd31-87ca-4460-b035-e3684c403d28 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:48.063696 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97d5bd31-87ca-4460-b035-e3684c403d28 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:48.117706 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-18a4cd00-8040-4f0d-960c-c3b239a69e4f req-44003469-7ec6-4168-a62f-3b49597ec323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7f8048-6316-49a6-89a0-2b5113d7d9f8", "name": "network-vif-plugged", "status": "completed", "tag": "caf2e138-8e60-4fcf-8119-71c69a88ae7d"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:48.132055 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-18a4cd00-8040-4f0d-960c-c3b239a69e4f req-44003469-7ec6-4168-a62f-3b49597ec323 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:48.137439 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-18a4cd00-8040-4f0d-960c-c3b239a69e4f req-44003469-7ec6-4168-a62f-3b49597ec323 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:48.144622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-18a4cd00-8040-4f0d-960c-c3b239a69e4f req-44003469-7ec6-4168-a62f-3b49597ec323 service nova] Creating event network-vif-plugged:caf2e138-8e60-4fcf-8119-71c69a88ae7d for instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 on hv-cinder-85001 Jul 18 02:36:48.150211 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-18a4cd00-8040-4f0d-960c-c3b239a69e4f req-44003469-7ec6-4168-a62f-3b49597ec323 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036161 Jul 18 02:36:48.151047 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 87/190] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:36:48.205309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-97d5bd31-87ca-4460-b035-e3684c403d28 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:48.213200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-97d5bd31-87ca-4460-b035-e3684c403d28 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.166434 Jul 18 02:36:48.216352 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 104/191] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:48 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:49.232366 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bdf06407-fb06-4014-9601-3ad6ff2003f3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:49.233064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bdf06407-fb06-4014-9601-3ad6ff2003f3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:49.239418 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bdf06407-fb06-4014-9601-3ad6ff2003f3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:49.239872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bdf06407-fb06-4014-9601-3ad6ff2003f3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:49.240627 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bdf06407-fb06-4014-9601-3ad6ff2003f3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:49.241107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bdf06407-fb06-4014-9601-3ad6ff2003f3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:49.374891 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bdf06407-fb06-4014-9601-3ad6ff2003f3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:49.382286 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bdf06407-fb06-4014-9601-3ad6ff2003f3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.154503 Jul 18 02:36:49.382854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 88/192] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:49 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:50.164571 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-9279576d-cba2-4e65-a4d7-b561b088ced4 req-3f07f6e8-d952-456b-81b8-bde0cc6813e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a73b2c-9286-4682-a1d3-a1893278cead", "name": "network-vif-plugged", "status": "completed", "tag": "724ae0ef-7a5c-49c2-8a15-2a37d668dc73"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:50.172502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-9279576d-cba2-4e65-a4d7-b561b088ced4 req-3f07f6e8-d952-456b-81b8-bde0cc6813e9 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:50.175053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-9279576d-cba2-4e65-a4d7-b561b088ced4 req-3f07f6e8-d952-456b-81b8-bde0cc6813e9 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:50.183723 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-9279576d-cba2-4e65-a4d7-b561b088ced4 req-3f07f6e8-d952-456b-81b8-bde0cc6813e9 service nova] Creating event network-vif-plugged:724ae0ef-7a5c-49c2-8a15-2a37d668dc73 for instance 64a73b2c-9286-4682-a1d3-a1893278cead on hv-cinder-85001 Jul 18 02:36:50.188822 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-9279576d-cba2-4e65-a4d7-b561b088ced4 req-3f07f6e8-d952-456b-81b8-bde0cc6813e9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027940 Jul 18 02:36:50.189430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 105/193] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:36:50.398482 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-53871562-56ca-4884-b801-065a794a399a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:50.399103 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-53871562-56ca-4884-b801-065a794a399a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:50.406154 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53871562-56ca-4884-b801-065a794a399a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:50.406611 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53871562-56ca-4884-b801-065a794a399a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:50.407387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53871562-56ca-4884-b801-065a794a399a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:50.407833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53871562-56ca-4884-b801-065a794a399a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:50.556240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-53871562-56ca-4884-b801-065a794a399a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:50.562349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-53871562-56ca-4884-b801-065a794a399a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.167805 Jul 18 02:36:50.563057 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 89/194] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:50 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:51.579741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-18c7b4d3-a232-4381-81e3-2894fdde33b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:51.580539 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-18c7b4d3-a232-4381-81e3-2894fdde33b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:51.586714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-18c7b4d3-a232-4381-81e3-2894fdde33b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:51.587158 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-18c7b4d3-a232-4381-81e3-2894fdde33b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:51.587910 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-18c7b4d3-a232-4381-81e3-2894fdde33b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:51.588337 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-18c7b4d3-a232-4381-81e3-2894fdde33b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:51.726161 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-18c7b4d3-a232-4381-81e3-2894fdde33b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:51.733934 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-18c7b4d3-a232-4381-81e3-2894fdde33b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.159126 Jul 18 02:36:51.734560 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 106/195] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:51 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:52.751170 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-340a05d7-3a4d-437f-95b2-b47d9568e5c5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:52.752392 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-340a05d7-3a4d-437f-95b2-b47d9568e5c5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:52.759267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-340a05d7-3a4d-437f-95b2-b47d9568e5c5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.759455 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-340a05d7-3a4d-437f-95b2-b47d9568e5c5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.760225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-340a05d7-3a4d-437f-95b2-b47d9568e5c5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:52.760663 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-340a05d7-3a4d-437f-95b2-b47d9568e5c5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:52.920847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-340a05d7-3a4d-437f-95b2-b47d9568e5c5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:52.929111 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-340a05d7-3a4d-437f-95b2-b47d9568e5c5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1321 microversion: 2.1 time: 0.182308 Jul 18 02:36:52.929702 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 90/196] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:52 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:53.947695 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-267b0d9b-d0e2-440d-a72a-b45b8604945c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:53.948523 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-267b0d9b-d0e2-440d-a72a-b45b8604945c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:53.956419 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-267b0d9b-d0e2-440d-a72a-b45b8604945c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:53.956868 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-267b0d9b-d0e2-440d-a72a-b45b8604945c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:53.957627 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-267b0d9b-d0e2-440d-a72a-b45b8604945c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:53.958130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-267b0d9b-d0e2-440d-a72a-b45b8604945c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:54.132246 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-267b0d9b-d0e2-440d-a72a-b45b8604945c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:54.140824 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-267b0d9b-d0e2-440d-a72a-b45b8604945c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1514 microversion: 2.1 time: 0.196759 Jul 18 02:36:54.141851 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 107/197] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:53 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:54.158777 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4862763c-a637-4096-9098-71b90629d061 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:54.159742 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4862763c-a637-4096-9098-71b90629d061 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:54.165721 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4862763c-a637-4096-9098-71b90629d061 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:54.166459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4862763c-a637-4096-9098-71b90629d061 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:54.167441 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4862763c-a637-4096-9098-71b90629d061 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:54.168014 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4862763c-a637-4096-9098-71b90629d061 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:54.193253 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-4862763c-a637-4096-9098-71b90629d061 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lazy-loading 'flavor' on Instance uuid 64a73b2c-9286-4682-a1d3-a1893278cead {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:36:54.592488 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4862763c-a637-4096-9098-71b90629d061 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead/action" status: 200 len: 32 microversion: 2.1 time: 0.438652 Jul 18 02:36:54.593006 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 91/198] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:36:54 2022] POST /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead/action => generated 32 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:36:54.602510 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7c3faf34-5676-4b35-81e4-6d8178df0b5c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:54.603127 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7c3faf34-5676-4b35-81e4-6d8178df0b5c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:54.610126 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7c3faf34-5676-4b35-81e4-6d8178df0b5c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:54.610700 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7c3faf34-5676-4b35-81e4-6d8178df0b5c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:54.611601 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7c3faf34-5676-4b35-81e4-6d8178df0b5c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:54.612110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7c3faf34-5676-4b35-81e4-6d8178df0b5c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:54.755573 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7c3faf34-5676-4b35-81e4-6d8178df0b5c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:54.763509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7c3faf34-5676-4b35-81e4-6d8178df0b5c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.165167 Jul 18 02:36:54.764082 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 108/199] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:54 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:55.783280 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-40be5669-588b-4da1-b426-58ac572419af tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:55.783993 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-40be5669-588b-4da1-b426-58ac572419af tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:55.790572 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-40be5669-588b-4da1-b426-58ac572419af tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:55.791030 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-40be5669-588b-4da1-b426-58ac572419af tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:55.791805 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-40be5669-588b-4da1-b426-58ac572419af tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:55.792246 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-40be5669-588b-4da1-b426-58ac572419af tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:55.925889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-40be5669-588b-4da1-b426-58ac572419af tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:55.933628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-40be5669-588b-4da1-b426-58ac572419af tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.156206 Jul 18 02:36:55.934264 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 92/200] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:55 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:56.195665 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-69988783", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "networks": [{"uuid": "751f7927-6223-4192-b4ba-501ca0955707"}]}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:36:56.247974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] validate_networks() for [('751f7927-6223-4192-b4ba-501ca0955707', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:36:56.597341 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:36:56.597895 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:36:56.598413 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:36:56.598825 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:36:56.599269 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:36:56.608488 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:56.608934 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:56.609732 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:56.610197 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:56.629044 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Getting quotas for project d615520de8a64205981c88430498f5f6. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:36:56.633178 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Getting quotas for user 86d9949aaf5749c9b00e1e04171e6f93 and project d615520de8a64205981c88430498f5f6. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:36:56.644981 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:36:56.647300 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:36:56.783494 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-cdc80394-e32e-4837-8b81-98f591ae02b6 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591386 Jul 18 02:36:56.784059 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 109/201] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:36:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:36:56.793689 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b1c5e6be-289b-4ea3-833e-cb1c233fed3a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:56.794362 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b1c5e6be-289b-4ea3-833e-cb1c233fed3a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:56.846902 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b1c5e6be-289b-4ea3-833e-cb1c233fed3a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:56.853430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b1c5e6be-289b-4ea3-833e-cb1c233fed3a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1212 microversion: 2.1 time: 0.063457 Jul 18 02:36:56.854792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 93/202] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:56 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1212 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:56.951222 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-eff9a2bc-e462-46ca-942a-154f8523a713 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:56.951848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-eff9a2bc-e462-46ca-942a-154f8523a713 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:56.958408 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eff9a2bc-e462-46ca-942a-154f8523a713 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:56.958967 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eff9a2bc-e462-46ca-942a-154f8523a713 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:56.959729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eff9a2bc-e462-46ca-942a-154f8523a713 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:56.960162 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eff9a2bc-e462-46ca-942a-154f8523a713 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:57.090642 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-eff9a2bc-e462-46ca-942a-154f8523a713 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:57.098145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-eff9a2bc-e462-46ca-942a-154f8523a713 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.151314 Jul 18 02:36:57.098716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 110/203] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:56 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:57.870679 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9e46a2e3-97ab-4029-9918-2e37e5ccc48d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:57.871220 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9e46a2e3-97ab-4029-9918-2e37e5ccc48d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:57.924798 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9e46a2e3-97ab-4029-9918-2e37e5ccc48d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:57.931646 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9e46a2e3-97ab-4029-9918-2e37e5ccc48d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1212 microversion: 2.1 time: 0.064847 Jul 18 02:36:57.932662 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 94/204] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:57 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1212 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:58.118324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-596b8ae8-d3e2-4555-a1cc-9e969326b2c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:58.118963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-596b8ae8-d3e2-4555-a1cc-9e969326b2c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:58.125933 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-596b8ae8-d3e2-4555-a1cc-9e969326b2c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:58.126349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-596b8ae8-d3e2-4555-a1cc-9e969326b2c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:58.127116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-596b8ae8-d3e2-4555-a1cc-9e969326b2c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:58.127557 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-596b8ae8-d3e2-4555-a1cc-9e969326b2c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:58.270752 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-596b8ae8-d3e2-4555-a1cc-9e969326b2c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:58.279123 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-596b8ae8-d3e2-4555-a1cc-9e969326b2c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.164912 Jul 18 02:36:58.280139 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 111/205] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:58 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:58.949705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b8631914-ea87-4469-9ccb-af0c9c1fb5a5 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:58.950357 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b8631914-ea87-4469-9ccb-af0c9c1fb5a5 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:58.957762 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b8631914-ea87-4469-9ccb-af0c9c1fb5a5 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:58.958244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b8631914-ea87-4469-9ccb-af0c9c1fb5a5 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:58.959016 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b8631914-ea87-4469-9ccb-af0c9c1fb5a5 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:58.959452 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b8631914-ea87-4469-9ccb-af0c9c1fb5a5 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.028957 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b8631914-ea87-4469-9ccb-af0c9c1fb5a5 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:59.037191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b8631914-ea87-4469-9ccb-af0c9c1fb5a5 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1264 microversion: 2.1 time: 0.091316 Jul 18 02:36:59.037766 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 95/206] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:58 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1264 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:36:59.296620 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-531669c5-3e15-44f8-81a1-64a35eb18f14 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:36:59.297304 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-531669c5-3e15-44f8-81a1-64a35eb18f14 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:36:59.304161 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-531669c5-3e15-44f8-81a1-64a35eb18f14 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.304824 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-531669c5-3e15-44f8-81a1-64a35eb18f14 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.305889 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-531669c5-3e15-44f8-81a1-64a35eb18f14 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:36:59.306353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-531669c5-3e15-44f8-81a1-64a35eb18f14 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:36:59.455922 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-531669c5-3e15-44f8-81a1-64a35eb18f14 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:36:59.465989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-531669c5-3e15-44f8-81a1-64a35eb18f14 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.172906 Jul 18 02:36:59.466363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 112/207] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:36:59 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:00.053835 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b33a4391-78de-4fa0-bc41-850518442991 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:00.054477 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b33a4391-78de-4fa0-bc41-850518442991 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:00.061824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b33a4391-78de-4fa0-bc41-850518442991 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:00.062308 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b33a4391-78de-4fa0-bc41-850518442991 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:00.063117 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b33a4391-78de-4fa0-bc41-850518442991 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:00.063556 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b33a4391-78de-4fa0-bc41-850518442991 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:00.081753 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:00.130388 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b33a4391-78de-4fa0-bc41-850518442991 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:00.137706 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b33a4391-78de-4fa0-bc41-850518442991 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1270 microversion: 2.1 time: 0.087842 Jul 18 02:37:00.138313 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 96/208] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:00 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:00.484475 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3a8efb31-0860-4a85-bd54-5f4175c74d13 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:00.485083 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3a8efb31-0860-4a85-bd54-5f4175c74d13 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:00.491230 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3a8efb31-0860-4a85-bd54-5f4175c74d13 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:00.491688 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3a8efb31-0860-4a85-bd54-5f4175c74d13 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:00.492517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3a8efb31-0860-4a85-bd54-5f4175c74d13 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:00.492953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3a8efb31-0860-4a85-bd54-5f4175c74d13 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:00.602101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-56e310a4-547b-4749-9d8c-e2b457d8d514 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:00.602596 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-56e310a4-547b-4749-9d8c-e2b457d8d514 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:00.610202 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-56e310a4-547b-4749-9d8c-e2b457d8d514 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:00.610659 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-56e310a4-547b-4749-9d8c-e2b457d8d514 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:00.611432 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-56e310a4-547b-4749-9d8c-e2b457d8d514 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:00.611865 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-56e310a4-547b-4749-9d8c-e2b457d8d514 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:00.625407 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3a8efb31-0860-4a85-bd54-5f4175c74d13 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:00.633279 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3a8efb31-0860-4a85-bd54-5f4175c74d13 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.153407 Jul 18 02:37:00.633850 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 113/209] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:00 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:00.636076 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-56e310a4-547b-4749-9d8c-e2b457d8d514 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/ips" status: 200 len: 145 microversion: 2.1 time: 0.037831 Jul 18 02:37:00.636644 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 97/210] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 18 02:37:00 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:37:01.155512 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1a0dbbdf-0a90-4ca5-9868-2fabe4ce2bc8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:01.156158 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1a0dbbdf-0a90-4ca5-9868-2fabe4ce2bc8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:01.162163 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a0dbbdf-0a90-4ca5-9868-2fabe4ce2bc8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.162620 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a0dbbdf-0a90-4ca5-9868-2fabe4ce2bc8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.163387 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a0dbbdf-0a90-4ca5-9868-2fabe4ce2bc8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.163825 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a0dbbdf-0a90-4ca5-9868-2fabe4ce2bc8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.289277 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1a0dbbdf-0a90-4ca5-9868-2fabe4ce2bc8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:01.297070 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1a0dbbdf-0a90-4ca5-9868-2fabe4ce2bc8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.145929 Jul 18 02:37:01.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 114/211] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:01 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:01.650808 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-604cfccd-3217-47a2-b35f-1748f853d24b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:01.651419 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-604cfccd-3217-47a2-b35f-1748f853d24b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:01.658973 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-604cfccd-3217-47a2-b35f-1748f853d24b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.659427 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-604cfccd-3217-47a2-b35f-1748f853d24b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.660232 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-604cfccd-3217-47a2-b35f-1748f853d24b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:01.660676 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-604cfccd-3217-47a2-b35f-1748f853d24b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:01.790335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-604cfccd-3217-47a2-b35f-1748f853d24b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:01.798566 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-604cfccd-3217-47a2-b35f-1748f853d24b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.151667 Jul 18 02:37:01.799172 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 98/212] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:01 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:02.314155 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4001a0c3-e8f1-4bb4-95c0-2071d650cc40 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:02.315039 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4001a0c3-e8f1-4bb4-95c0-2071d650cc40 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:02.317468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:02.323579 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4001a0c3-e8f1-4bb4-95c0-2071d650cc40 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:02.324040 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4001a0c3-e8f1-4bb4-95c0-2071d650cc40 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:02.324772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4001a0c3-e8f1-4bb4-95c0-2071d650cc40 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:02.325298 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4001a0c3-e8f1-4bb4-95c0-2071d650cc40 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:02.328468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=97 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:02.456879 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4001a0c3-e8f1-4bb4-95c0-2071d650cc40 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:02.464176 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4001a0c3-e8f1-4bb4-95c0-2071d650cc40 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.154385 Jul 18 02:37:02.464944 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 115/213] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:02 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:02.815573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-546d94fa-6e9b-46e9-9600-115a5934ba06 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:02.816294 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-546d94fa-6e9b-46e9-9600-115a5934ba06 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:02.819929 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=51 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:02.823338 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-546d94fa-6e9b-46e9-9600-115a5934ba06 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:02.823792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-546d94fa-6e9b-46e9-9600-115a5934ba06 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:02.824565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-546d94fa-6e9b-46e9-9600-115a5934ba06 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:02.825295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-546d94fa-6e9b-46e9-9600-115a5934ba06 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:02.967027 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-546d94fa-6e9b-46e9-9600-115a5934ba06 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:02.976396 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-546d94fa-6e9b-46e9-9600-115a5934ba06 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.164571 Jul 18 02:37:02.977378 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 99/214] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:02 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:03.039618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ab874d38-ce65-465e-ad9e-0c1234ae1f1d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:03.040191 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ab874d38-ce65-465e-ad9e-0c1234ae1f1d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:03.047073 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab874d38-ce65-465e-ad9e-0c1234ae1f1d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.047707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab874d38-ce65-465e-ad9e-0c1234ae1f1d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.048488 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab874d38-ce65-465e-ad9e-0c1234ae1f1d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.048927 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ab874d38-ce65-465e-ad9e-0c1234ae1f1d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.078530 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ab874d38-ce65-465e-ad9e-0c1234ae1f1d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/ips" status: 200 len: 152 microversion: 2.20 time: 0.043603 Jul 18 02:37:03.079028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 116/215] 10.222.0.66 () {60 vars in 1288 bytes} [Mon Jul 18 02:37:03 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:37:03.362524 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-f19d0330-1ba7-4597-9332-bef7c9c10328 req-c4e6bb5e-1c02-483d-bbd1-2b619e970ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512cfd89-f539-4db2-ae0d-441520effb5e", "tag": "58895295-26ab-4273-99a5-951870952460"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:03.370372 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-f19d0330-1ba7-4597-9332-bef7c9c10328 req-c4e6bb5e-1c02-483d-bbd1-2b619e970ded service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.370818 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-f19d0330-1ba7-4597-9332-bef7c9c10328 req-c4e6bb5e-1c02-483d-bbd1-2b619e970ded service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.482322 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e51c0ba0-5578-4f83-8329-94722eaf455b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:03.483250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e51c0ba0-5578-4f83-8329-94722eaf455b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:03.491172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e51c0ba0-5578-4f83-8329-94722eaf455b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.491694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e51c0ba0-5578-4f83-8329-94722eaf455b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.494681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e51c0ba0-5578-4f83-8329-94722eaf455b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.495324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e51c0ba0-5578-4f83-8329-94722eaf455b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.524903 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-f19d0330-1ba7-4597-9332-bef7c9c10328 req-c4e6bb5e-1c02-483d-bbd1-2b619e970ded service nova] Creating event network-changed:58895295-26ab-4273-99a5-951870952460 for instance 512cfd89-f539-4db2-ae0d-441520effb5e on hv-cinder-85001 Jul 18 02:37:03.530292 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-f19d0330-1ba7-4597-9332-bef7c9c10328 req-c4e6bb5e-1c02-483d-bbd1-2b619e970ded service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171154 Jul 18 02:37:03.531196 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 100/216] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:03.633333 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e51c0ba0-5578-4f83-8329-94722eaf455b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:03.640810 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e51c0ba0-5578-4f83-8329-94722eaf455b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.162834 Jul 18 02:37:03.641374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 117/217] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:03 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:03.763360 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-856e0b5d-8079-4db3-8987-2a0abccf577e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:03.763933 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-856e0b5d-8079-4db3-8987-2a0abccf577e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:03.778156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-856e0b5d-8079-4db3-8987-2a0abccf577e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.778610 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-856e0b5d-8079-4db3-8987-2a0abccf577e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.779382 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-856e0b5d-8079-4db3-8987-2a0abccf577e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:03.779927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-856e0b5d-8079-4db3-8987-2a0abccf577e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:03.804585 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-856e0b5d-8079-4db3-8987-2a0abccf577e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/ips" status: 200 len: 150 microversion: 2.1 time: 0.045389 Jul 18 02:37:03.805151 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 101/218] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 18 02:37:03 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:03.994349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7c1ca7b9-aee1-4e61-aa75-259a4eb39b2a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:03.995082 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7c1ca7b9-aee1-4e61-aa75-259a4eb39b2a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:04.001940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7c1ca7b9-aee1-4e61-aa75-259a4eb39b2a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.002418 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7c1ca7b9-aee1-4e61-aa75-259a4eb39b2a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.003171 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7c1ca7b9-aee1-4e61-aa75-259a4eb39b2a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.003598 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7c1ca7b9-aee1-4e61-aa75-259a4eb39b2a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.141732 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7c1ca7b9-aee1-4e61-aa75-259a4eb39b2a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:04.149738 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7c1ca7b9-aee1-4e61-aa75-259a4eb39b2a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.159497 Jul 18 02:37:04.150340 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 118/219] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:03 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:04.657726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1e158a32-ec14-442c-bc72-e4f7675dbf4a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:04.658439 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1e158a32-ec14-442c-bc72-e4f7675dbf4a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:04.665469 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1e158a32-ec14-442c-bc72-e4f7675dbf4a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.666216 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1e158a32-ec14-442c-bc72-e4f7675dbf4a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.667002 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1e158a32-ec14-442c-bc72-e4f7675dbf4a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:04.667450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1e158a32-ec14-442c-bc72-e4f7675dbf4a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:04.800751 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1e158a32-ec14-442c-bc72-e4f7675dbf4a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:04.808486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1e158a32-ec14-442c-bc72-e4f7675dbf4a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.155231 Jul 18 02:37:04.809058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 102/220] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:04 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:05.167653 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c8471563-af73-41d1-9474-1853f7b1dd03 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:05.168269 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c8471563-af73-41d1-9474-1853f7b1dd03 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:05.175631 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c8471563-af73-41d1-9474-1853f7b1dd03 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.177305 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c8471563-af73-41d1-9474-1853f7b1dd03 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.177305 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c8471563-af73-41d1-9474-1853f7b1dd03 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.177305 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c8471563-af73-41d1-9474-1853f7b1dd03 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.312170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c8471563-af73-41d1-9474-1853f7b1dd03 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:05.320528 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c8471563-af73-41d1-9474-1853f7b1dd03 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.156577 Jul 18 02:37:05.321230 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 119/221] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:05 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:05.825824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1ff4b515-251f-433a-8e87-d8e35b883080 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:05.826404 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1ff4b515-251f-433a-8e87-d8e35b883080 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:05.833733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1ff4b515-251f-433a-8e87-d8e35b883080 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.834216 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1ff4b515-251f-433a-8e87-d8e35b883080 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.834994 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1ff4b515-251f-433a-8e87-d8e35b883080 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:05.835433 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1ff4b515-251f-433a-8e87-d8e35b883080 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:05.976701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1ff4b515-251f-433a-8e87-d8e35b883080 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:05.976701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1ff4b515-251f-433a-8e87-d8e35b883080 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.152267 Jul 18 02:37:05.976701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 103/222] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:05 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:06.346462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-97ced66e-ce3d-4054-87d9-a000fd2a00bb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:06.347067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-97ced66e-ce3d-4054-87d9-a000fd2a00bb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:06.353185 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97ced66e-ce3d-4054-87d9-a000fd2a00bb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:06.353628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97ced66e-ce3d-4054-87d9-a000fd2a00bb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.354464 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97ced66e-ce3d-4054-87d9-a000fd2a00bb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:06.354904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97ced66e-ce3d-4054-87d9-a000fd2a00bb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.493215 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-97ced66e-ce3d-4054-87d9-a000fd2a00bb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:06.501571 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-97ced66e-ce3d-4054-87d9-a000fd2a00bb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.160106 Jul 18 02:37:06.502511 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 120/223] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:06 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:06.657876 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f8beae8c-2b37-4306-ba45-f143177860ea tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "978c3dee-b101-4468-925c-6179bb0bcd2b"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:06.659025 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f8beae8c-2b37-4306-ba45-f143177860ea tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:06.669664 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f8beae8c-2b37-4306-ba45-f143177860ea tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:06.669664 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f8beae8c-2b37-4306-ba45-f143177860ea tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.669664 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f8beae8c-2b37-4306-ba45-f143177860ea tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:06.669664 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f8beae8c-2b37-4306-ba45-f143177860ea tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:06.992901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f10238a3-2dc2-4eb8-afb1-7da0f26b732e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:06.993743 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f10238a3-2dc2-4eb8-afb1-7da0f26b732e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:06.996038 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:06.997141 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=6 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:07.003971 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f10238a3-2dc2-4eb8-afb1-7da0f26b732e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.003971 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f10238a3-2dc2-4eb8-afb1-7da0f26b732e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.005440 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f10238a3-2dc2-4eb8-afb1-7da0f26b732e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.006754 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f10238a3-2dc2-4eb8-afb1-7da0f26b732e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.538426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f8beae8c-2b37-4306-ba45-f143177860ea tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884623 Jul 18 02:37:07.539393 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 104/224] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:37:06 2022] POST /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments => generated 194 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:07.545226 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4ffd82fd-ddad-4364-925e-5455dc45a37f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:07.546555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4ffd82fd-ddad-4364-925e-5455dc45a37f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:07.553590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4ffd82fd-ddad-4364-925e-5455dc45a37f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.554042 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4ffd82fd-ddad-4364-925e-5455dc45a37f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.556068 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4ffd82fd-ddad-4364-925e-5455dc45a37f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.556773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4ffd82fd-ddad-4364-925e-5455dc45a37f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.589315 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-4ffd82fd-ddad-4364-925e-5455dc45a37f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lazy-loading 'flavor' on Instance uuid 68d974b9-4abf-4d7f-bbea-08e8fef381dd {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:07.643977 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f10238a3-2dc2-4eb8-afb1-7da0f26b732e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:07.652738 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f10238a3-2dc2-4eb8-afb1-7da0f26b732e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.664442 Jul 18 02:37:07.653667 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 121/225] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:06 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:07.659529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-256fec09-4974-40e1-8a4d-6ad1563a35b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed127def-76ea-4eaf-971f-23fba617f0f6"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:07.660643 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-256fec09-4974-40e1-8a4d-6ad1563a35b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:07.667100 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-256fec09-4974-40e1-8a4d-6ad1563a35b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.667548 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-256fec09-4974-40e1-8a4d-6ad1563a35b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.668581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-256fec09-4974-40e1-8a4d-6ad1563a35b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:07.668986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-256fec09-4974-40e1-8a4d-6ad1563a35b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:07.929687 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=4 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:08.389564 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4ffd82fd-ddad-4364-925e-5455dc45a37f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "POST /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/action" status: 202 len: 0 microversion: 2.20 time: 0.848538 Jul 18 02:37:08.393314 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 105/226] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Jul 18 02:37:07 2022] POST /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:37:08.399022 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-263a8dd9-816a-489d-be42-546661c6dbaf tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:08.399929 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-263a8dd9-816a-489d-be42-546661c6dbaf tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:08.406656 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-263a8dd9-816a-489d-be42-546661c6dbaf tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.407114 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-263a8dd9-816a-489d-be42-546661c6dbaf tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.407902 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-263a8dd9-816a-489d-be42-546661c6dbaf tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.408341 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-263a8dd9-816a-489d-be42-546661c6dbaf tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.547494 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-263a8dd9-816a-489d-be42-546661c6dbaf tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:08.555267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-263a8dd9-816a-489d-be42-546661c6dbaf tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.160541 Jul 18 02:37:08.555949 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 106/227] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:08 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:08.560522 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-34d84051-bd97-4123-afa5-1d8f2fbeab70 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:08.561126 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-34d84051-bd97-4123-afa5-1d8f2fbeab70 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:08.567350 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34d84051-bd97-4123-afa5-1d8f2fbeab70 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.567797 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34d84051-bd97-4123-afa5-1d8f2fbeab70 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.568557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34d84051-bd97-4123-afa5-1d8f2fbeab70 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.568986 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34d84051-bd97-4123-afa5-1d8f2fbeab70 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.706024 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-34d84051-bd97-4123-afa5-1d8f2fbeab70 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:08.713929 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-34d84051-bd97-4123-afa5-1d8f2fbeab70 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:08.715458 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-34d84051-bd97-4123-afa5-1d8f2fbeab70 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:08.716622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-34d84051-bd97-4123-afa5-1d8f2fbeab70 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.159865 Jul 18 02:37:08.717190 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 107/228] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:08 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:08.722044 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-94517455-b7ca-47e0-96a2-e94ea7913e6b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:08.722679 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-94517455-b7ca-47e0-96a2-e94ea7913e6b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:08.728874 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94517455-b7ca-47e0-96a2-e94ea7913e6b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.729325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94517455-b7ca-47e0-96a2-e94ea7913e6b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.730256 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94517455-b7ca-47e0-96a2-e94ea7913e6b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.730696 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94517455-b7ca-47e0-96a2-e94ea7913e6b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.866927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-94517455-b7ca-47e0-96a2-e94ea7913e6b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:08.875099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-94517455-b7ca-47e0-96a2-e94ea7913e6b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.156333 Jul 18 02:37:08.875856 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 108/229] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:08 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:08.880147 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-052741b5-1c43-4cd5-823c-ebddbca15be4 req-9822d6c3-8688-4a4b-ac49-da607b2d1fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512cfd89-f539-4db2-ae0d-441520effb5e", "name": "network-vif-plugged", "status": "completed", "tag": "58895295-26ab-4273-99a5-951870952460"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:08.888045 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-052741b5-1c43-4cd5-823c-ebddbca15be4 req-9822d6c3-8688-4a4b-ac49-da607b2d1fb2 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:08.888498 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-052741b5-1c43-4cd5-823c-ebddbca15be4 req-9822d6c3-8688-4a4b-ac49-da607b2d1fb2 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:08.899996 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-052741b5-1c43-4cd5-823c-ebddbca15be4 req-9822d6c3-8688-4a4b-ac49-da607b2d1fb2 service nova] Creating event network-vif-plugged:58895295-26ab-4273-99a5-951870952460 for instance 512cfd89-f539-4db2-ae0d-441520effb5e on hv-cinder-85001 Jul 18 02:37:08.905155 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-052741b5-1c43-4cd5-823c-ebddbca15be4 req-9822d6c3-8688-4a4b-ac49-da607b2d1fb2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028111 Jul 18 02:37:08.905856 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 109/230] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:09.572601 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-27ffb9fd-0440-4c25-b4c8-53a1be8d7fdb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:09.573289 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-27ffb9fd-0440-4c25-b4c8-53a1be8d7fdb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:09.580233 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-27ffb9fd-0440-4c25-b4c8-53a1be8d7fdb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.580685 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-27ffb9fd-0440-4c25-b4c8-53a1be8d7fdb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.581444 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-27ffb9fd-0440-4c25-b4c8-53a1be8d7fdb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.581880 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-27ffb9fd-0440-4c25-b4c8-53a1be8d7fdb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.655588 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-256fec09-4974-40e1-8a4d-6ad1563a35b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.000640 Jul 18 02:37:09.656419 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 122/231] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:37:07 2022] POST /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/os-volume_attachments => generated 194 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:09.720133 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-27ffb9fd-0440-4c25-b4c8-53a1be8d7fdb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:09.727804 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-27ffb9fd-0440-4c25-b4c8-53a1be8d7fdb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.159884 Jul 18 02:37:09.728371 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 110/232] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:09 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:09.736852 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e329886c-f26a-4a88-8b40-6eac23ef5320 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:09.741077 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e329886c-f26a-4a88-8b40-6eac23ef5320 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:09.743941 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e329886c-f26a-4a88-8b40-6eac23ef5320 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.744405 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e329886c-f26a-4a88-8b40-6eac23ef5320 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.745170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e329886c-f26a-4a88-8b40-6eac23ef5320 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.745610 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e329886c-f26a-4a88-8b40-6eac23ef5320 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.878258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e329886c-f26a-4a88-8b40-6eac23ef5320 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:09.886420 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e329886c-f26a-4a88-8b40-6eac23ef5320 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:09.888035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e329886c-f26a-4a88-8b40-6eac23ef5320 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:09.889208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e329886c-f26a-4a88-8b40-6eac23ef5320 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.156701 Jul 18 02:37:09.889766 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 123/233] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:09 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:09.893286 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fe9cc768-0eea-4f04-9c4d-c4ecaa97bfcc tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:09.894135 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fe9cc768-0eea-4f04-9c4d-c4ecaa97bfcc tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:09.900110 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe9cc768-0eea-4f04-9c4d-c4ecaa97bfcc tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.900620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe9cc768-0eea-4f04-9c4d-c4ecaa97bfcc tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:09.901586 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe9cc768-0eea-4f04-9c4d-c4ecaa97bfcc tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:09.902104 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe9cc768-0eea-4f04-9c4d-c4ecaa97bfcc tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.038743 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fe9cc768-0eea-4f04-9c4d-c4ecaa97bfcc tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:10.042407 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:10.047032 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fe9cc768-0eea-4f04-9c4d-c4ecaa97bfcc tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.158501 Jul 18 02:37:10.047794 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 111/234] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:09 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:10.744521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-397ab33c-47aa-40a2-8ac4-5a95d8108dd7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:10.745116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-397ab33c-47aa-40a2-8ac4-5a95d8108dd7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:10.751437 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-397ab33c-47aa-40a2-8ac4-5a95d8108dd7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.754271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-397ab33c-47aa-40a2-8ac4-5a95d8108dd7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.754271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-397ab33c-47aa-40a2-8ac4-5a95d8108dd7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.754271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-397ab33c-47aa-40a2-8ac4-5a95d8108dd7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.883185 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-397ab33c-47aa-40a2-8ac4-5a95d8108dd7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:10.890988 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-397ab33c-47aa-40a2-8ac4-5a95d8108dd7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.150232 Jul 18 02:37:10.891561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 124/235] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:10 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:10.909128 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-60e53a29-2b57-48f5-a8c9-a23eec572472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:10.909737 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-60e53a29-2b57-48f5-a8c9-a23eec572472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:10.916619 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60e53a29-2b57-48f5-a8c9-a23eec572472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.917068 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60e53a29-2b57-48f5-a8c9-a23eec572472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:10.917844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60e53a29-2b57-48f5-a8c9-a23eec572472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:10.918298 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60e53a29-2b57-48f5-a8c9-a23eec572472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:11.050252 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-60e53a29-2b57-48f5-a8c9-a23eec572472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:11.058169 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-60e53a29-2b57-48f5-a8c9-a23eec572472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:11.059683 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-60e53a29-2b57-48f5-a8c9-a23eec572472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:11.060855 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-60e53a29-2b57-48f5-a8c9-a23eec572472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.157177 Jul 18 02:37:11.061411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 112/236] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:10 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:11.065520 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7e02038b-03f8-4dfe-adcb-7009d0848a24 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:11.066172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7e02038b-03f8-4dfe-adcb-7009d0848a24 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:11.072166 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7e02038b-03f8-4dfe-adcb-7009d0848a24 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:11.072607 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7e02038b-03f8-4dfe-adcb-7009d0848a24 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:11.073360 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7e02038b-03f8-4dfe-adcb-7009d0848a24 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:11.073789 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7e02038b-03f8-4dfe-adcb-7009d0848a24 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:11.205491 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7e02038b-03f8-4dfe-adcb-7009d0848a24 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:11.213739 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7e02038b-03f8-4dfe-adcb-7009d0848a24 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.152736 Jul 18 02:37:11.214346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 125/237] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:11 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:11.908234 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f4fbb655-e006-4f9a-96c8-2a120e1849ed tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:11.908832 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f4fbb655-e006-4f9a-96c8-2a120e1849ed tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:11.915270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4fbb655-e006-4f9a-96c8-2a120e1849ed tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:11.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4fbb655-e006-4f9a-96c8-2a120e1849ed tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:11.916456 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4fbb655-e006-4f9a-96c8-2a120e1849ed tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:11.916886 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4fbb655-e006-4f9a-96c8-2a120e1849ed tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.043976 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f4fbb655-e006-4f9a-96c8-2a120e1849ed tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:12.052104 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f4fbb655-e006-4f9a-96c8-2a120e1849ed tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.148137 Jul 18 02:37:12.052670 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 113/238] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:11 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:12.079391 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fb6f53ba-0a5d-42c4-aa20-4c8a5eb4a9ee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:12.080064 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fb6f53ba-0a5d-42c4-aa20-4c8a5eb4a9ee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:12.086393 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fb6f53ba-0a5d-42c4-aa20-4c8a5eb4a9ee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.086846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fb6f53ba-0a5d-42c4-aa20-4c8a5eb4a9ee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.087593 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fb6f53ba-0a5d-42c4-aa20-4c8a5eb4a9ee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.088022 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fb6f53ba-0a5d-42c4-aa20-4c8a5eb4a9ee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.220431 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fb6f53ba-0a5d-42c4-aa20-4c8a5eb4a9ee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:12.228832 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fb6f53ba-0a5d-42c4-aa20-4c8a5eb4a9ee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:12.230359 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fb6f53ba-0a5d-42c4-aa20-4c8a5eb4a9ee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:12.231528 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fb6f53ba-0a5d-42c4-aa20-4c8a5eb4a9ee tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.156531 Jul 18 02:37:12.232242 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 126/239] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:12 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:12.232653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-628311fa-81e3-4089-8e1e-28fea421d17b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:12.233270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-628311fa-81e3-4089-8e1e-28fea421d17b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:12.239918 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-628311fa-81e3-4089-8e1e-28fea421d17b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.240370 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-628311fa-81e3-4089-8e1e-28fea421d17b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.241437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-628311fa-81e3-4089-8e1e-28fea421d17b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:12.241870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-628311fa-81e3-4089-8e1e-28fea421d17b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:12.380445 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-628311fa-81e3-4089-8e1e-28fea421d17b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:12.387740 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-628311fa-81e3-4089-8e1e-28fea421d17b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.158966 Jul 18 02:37:12.388308 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 114/240] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:12 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:13.068693 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f297287a-78c8-421a-963d-8c2e0ed39c7b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:13.069300 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f297287a-78c8-421a-963d-8c2e0ed39c7b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:13.075379 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f297287a-78c8-421a-963d-8c2e0ed39c7b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:13.075827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f297287a-78c8-421a-963d-8c2e0ed39c7b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:13.076581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f297287a-78c8-421a-963d-8c2e0ed39c7b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:13.077308 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f297287a-78c8-421a-963d-8c2e0ed39c7b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:13.212691 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f297287a-78c8-421a-963d-8c2e0ed39c7b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:13.221301 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f297287a-78c8-421a-963d-8c2e0ed39c7b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.156394 Jul 18 02:37:13.221860 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 127/241] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:13 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:13.250503 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b40b3087-02ad-4092-b876-e4b388fd13f6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:13.251121 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b40b3087-02ad-4092-b876-e4b388fd13f6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:13.257674 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b40b3087-02ad-4092-b876-e4b388fd13f6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:13.258163 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b40b3087-02ad-4092-b876-e4b388fd13f6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:13.258947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b40b3087-02ad-4092-b876-e4b388fd13f6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:13.259390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b40b3087-02ad-4092-b876-e4b388fd13f6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:13.399026 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b40b3087-02ad-4092-b876-e4b388fd13f6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:13.403426 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-63283536-a946-4419-a4b2-a73985b1890b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:13.404298 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-63283536-a946-4419-a4b2-a73985b1890b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:13.408529 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b40b3087-02ad-4092-b876-e4b388fd13f6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:13.410440 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b40b3087-02ad-4092-b876-e4b388fd13f6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:13.411218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-63283536-a946-4419-a4b2-a73985b1890b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:13.411667 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-63283536-a946-4419-a4b2-a73985b1890b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:13.411800 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b40b3087-02ad-4092-b876-e4b388fd13f6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.165115 Jul 18 02:37:13.413217 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-63283536-a946-4419-a4b2-a73985b1890b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:13.413345 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 115/242] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:13 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:13.413438 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-63283536-a946-4419-a4b2-a73985b1890b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:13.542981 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-63283536-a946-4419-a4b2-a73985b1890b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:13.551164 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-63283536-a946-4419-a4b2-a73985b1890b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.151476 Jul 18 02:37:13.551743 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 128/243] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:13 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:14.237381 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-623a0df9-1744-4ca8-b36f-e6d5d1b8fa92 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:14.238034 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-623a0df9-1744-4ca8-b36f-e6d5d1b8fa92 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:14.244117 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-623a0df9-1744-4ca8-b36f-e6d5d1b8fa92 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.244573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-623a0df9-1744-4ca8-b36f-e6d5d1b8fa92 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.245347 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-623a0df9-1744-4ca8-b36f-e6d5d1b8fa92 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.245786 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-623a0df9-1744-4ca8-b36f-e6d5d1b8fa92 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.385103 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-623a0df9-1744-4ca8-b36f-e6d5d1b8fa92 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:14.393794 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-623a0df9-1744-4ca8-b36f-e6d5d1b8fa92 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.160295 Jul 18 02:37:14.394476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 116/244] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:14 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:14.430493 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-02c0687c-fa6c-430e-ad19-083d0b781503 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:14.431089 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-02c0687c-fa6c-430e-ad19-083d0b781503 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:14.437461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-02c0687c-fa6c-430e-ad19-083d0b781503 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.438499 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-02c0687c-fa6c-430e-ad19-083d0b781503 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.439338 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-02c0687c-fa6c-430e-ad19-083d0b781503 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.439767 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-02c0687c-fa6c-430e-ad19-083d0b781503 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.567778 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f9085c76-777b-48e8-852c-fd2c9e901ab3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:14.568385 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f9085c76-777b-48e8-852c-fd2c9e901ab3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:14.574427 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9085c76-777b-48e8-852c-fd2c9e901ab3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.574878 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9085c76-777b-48e8-852c-fd2c9e901ab3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.575189 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-02c0687c-fa6c-430e-ad19-083d0b781503 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:14.575643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9085c76-777b-48e8-852c-fd2c9e901ab3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:14.576080 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9085c76-777b-48e8-852c-fd2c9e901ab3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:14.584267 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-02c0687c-fa6c-430e-ad19-083d0b781503 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:14.585822 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-02c0687c-fa6c-430e-ad19-083d0b781503 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:14.587013 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-02c0687c-fa6c-430e-ad19-083d0b781503 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.160366 Jul 18 02:37:14.587618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 129/245] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:14 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:14.705083 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f9085c76-777b-48e8-852c-fd2c9e901ab3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:14.712332 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f9085c76-777b-48e8-852c-fd2c9e901ab3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.148679 Jul 18 02:37:14.712903 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 117/246] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:14 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:15.410912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-065ab1dd-2825-40ec-81c4-da88a4b783f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:15.411528 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-065ab1dd-2825-40ec-81c4-da88a4b783f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:15.417638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-065ab1dd-2825-40ec-81c4-da88a4b783f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.418128 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-065ab1dd-2825-40ec-81c4-da88a4b783f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.418897 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-065ab1dd-2825-40ec-81c4-da88a4b783f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.419336 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-065ab1dd-2825-40ec-81c4-da88a4b783f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.556057 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-065ab1dd-2825-40ec-81c4-da88a4b783f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:15.558387 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:15.564757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-065ab1dd-2825-40ec-81c4-da88a4b783f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.157618 Jul 18 02:37:15.571384 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 130/247] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:15 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:15.604712 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c7e0de1a-7316-4409-9e6d-6e5d5747ac1b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:15.605315 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c7e0de1a-7316-4409-9e6d-6e5d5747ac1b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:15.612573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c7e0de1a-7316-4409-9e6d-6e5d5747ac1b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.613511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c7e0de1a-7316-4409-9e6d-6e5d5747ac1b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.613762 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c7e0de1a-7316-4409-9e6d-6e5d5747ac1b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.614229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c7e0de1a-7316-4409-9e6d-6e5d5747ac1b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.729239 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-01852317-8f7a-47f5-9216-e67562022e01 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:15.729839 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-01852317-8f7a-47f5-9216-e67562022e01 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:15.737691 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01852317-8f7a-47f5-9216-e67562022e01 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.738159 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01852317-8f7a-47f5-9216-e67562022e01 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.738925 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01852317-8f7a-47f5-9216-e67562022e01 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:15.739354 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01852317-8f7a-47f5-9216-e67562022e01 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:15.746907 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c7e0de1a-7316-4409-9e6d-6e5d5747ac1b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:15.755514 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c7e0de1a-7316-4409-9e6d-6e5d5747ac1b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:15.757065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c7e0de1a-7316-4409-9e6d-6e5d5747ac1b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:15.758274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c7e0de1a-7316-4409-9e6d-6e5d5747ac1b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.157295 Jul 18 02:37:15.758829 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 118/248] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:15 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:15.871559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-01852317-8f7a-47f5-9216-e67562022e01 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:15.879286 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-01852317-8f7a-47f5-9216-e67562022e01 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.153833 Jul 18 02:37:15.879859 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 131/249] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:15 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:16.586477 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-83ca01b5-728a-49a2-9309-9e6a1cd45329 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:16.587013 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-83ca01b5-728a-49a2-9309-9e6a1cd45329 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:16.593022 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83ca01b5-728a-49a2-9309-9e6a1cd45329 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.593466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83ca01b5-728a-49a2-9309-9e6a1cd45329 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.594939 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83ca01b5-728a-49a2-9309-9e6a1cd45329 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.595497 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83ca01b5-728a-49a2-9309-9e6a1cd45329 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.730243 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-83ca01b5-728a-49a2-9309-9e6a1cd45329 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:16.738832 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-83ca01b5-728a-49a2-9309-9e6a1cd45329 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.156145 Jul 18 02:37:16.739411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 119/250] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:16 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:16.777069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ed5caba0-cd64-4676-86d1-726f8feb544d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:16.777771 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ed5caba0-cd64-4676-86d1-726f8feb544d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:16.786301 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ed5caba0-cd64-4676-86d1-726f8feb544d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.786762 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ed5caba0-cd64-4676-86d1-726f8feb544d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.787525 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ed5caba0-cd64-4676-86d1-726f8feb544d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.787963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ed5caba0-cd64-4676-86d1-726f8feb544d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.895926 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-46767a3d-e0eb-42a9-9ed5-88d9ab98540f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:16.896535 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-46767a3d-e0eb-42a9-9ed5-88d9ab98540f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:16.902497 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-46767a3d-e0eb-42a9-9ed5-88d9ab98540f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.902951 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-46767a3d-e0eb-42a9-9ed5-88d9ab98540f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.903720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-46767a3d-e0eb-42a9-9ed5-88d9ab98540f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:16.904156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-46767a3d-e0eb-42a9-9ed5-88d9ab98540f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:16.921880 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ed5caba0-cd64-4676-86d1-726f8feb544d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:16.931303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ed5caba0-cd64-4676-86d1-726f8feb544d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:16.932800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ed5caba0-cd64-4676-86d1-726f8feb544d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:16.933962 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ed5caba0-cd64-4676-86d1-726f8feb544d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.161466 Jul 18 02:37:16.935023 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 132/251] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:16 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:17.034904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-46767a3d-e0eb-42a9-9ed5-88d9ab98540f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:17.042816 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-46767a3d-e0eb-42a9-9ed5-88d9ab98540f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1312 microversion: 2.1 time: 0.150789 Jul 18 02:37:17.043378 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 120/252] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:16 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:17.756033 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3a6a58ca-8660-473b-a8d7-50d2af21c127 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:17.756663 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3a6a58ca-8660-473b-a8d7-50d2af21c127 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:17.763051 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3a6a58ca-8660-473b-a8d7-50d2af21c127 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.763504 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3a6a58ca-8660-473b-a8d7-50d2af21c127 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.764301 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3a6a58ca-8660-473b-a8d7-50d2af21c127 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.764744 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3a6a58ca-8660-473b-a8d7-50d2af21c127 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.899028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3a6a58ca-8660-473b-a8d7-50d2af21c127 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:17.909455 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3a6a58ca-8660-473b-a8d7-50d2af21c127 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.154960 Jul 18 02:37:17.909455 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 133/253] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:17 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:17.953066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-08e5188a-3fc5-4d7f-b517-ba5fc1884a6b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:17.954341 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-08e5188a-3fc5-4d7f-b517-ba5fc1884a6b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:17.962007 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-08e5188a-3fc5-4d7f-b517-ba5fc1884a6b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.962573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-08e5188a-3fc5-4d7f-b517-ba5fc1884a6b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:17.963519 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-08e5188a-3fc5-4d7f-b517-ba5fc1884a6b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:17.963983 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-08e5188a-3fc5-4d7f-b517-ba5fc1884a6b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.061214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0dffdcd9-4327-44d9-812c-983bc4baa618 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:18.062016 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0dffdcd9-4327-44d9-812c-983bc4baa618 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:18.068262 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0dffdcd9-4327-44d9-812c-983bc4baa618 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.068789 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0dffdcd9-4327-44d9-812c-983bc4baa618 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.069549 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0dffdcd9-4327-44d9-812c-983bc4baa618 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.069977 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0dffdcd9-4327-44d9-812c-983bc4baa618 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.104291 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-08e5188a-3fc5-4d7f-b517-ba5fc1884a6b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:18.113727 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-08e5188a-3fc5-4d7f-b517-ba5fc1884a6b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:18.115916 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-08e5188a-3fc5-4d7f-b517-ba5fc1884a6b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:18.117337 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-08e5188a-3fc5-4d7f-b517-ba5fc1884a6b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.168446 Jul 18 02:37:18.118523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 121/254] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:17 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:18.206356 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0dffdcd9-4327-44d9-812c-983bc4baa618 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:18.214785 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0dffdcd9-4327-44d9-812c-983bc4baa618 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1496 microversion: 2.1 time: 0.158261 Jul 18 02:37:18.226202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 134/255] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:18 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1496 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:18.924969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-24e6120c-63d6-4f23-91bb-be185c838437 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:18.925582 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-24e6120c-63d6-4f23-91bb-be185c838437 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:18.931975 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24e6120c-63d6-4f23-91bb-be185c838437 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.932433 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24e6120c-63d6-4f23-91bb-be185c838437 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:18.933243 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24e6120c-63d6-4f23-91bb-be185c838437 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:18.933690 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24e6120c-63d6-4f23-91bb-be185c838437 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:19.064821 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-24e6120c-63d6-4f23-91bb-be185c838437 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:19.072825 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-24e6120c-63d6-4f23-91bb-be185c838437 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.151888 Jul 18 02:37:19.073490 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 122/256] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:18 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:19.120486 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-adbb778f-35a8-4040-8172-c3a31f7a0e52 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: .version_select at 0x7f28ee73f9d0>, body: {"keypair": {"name": "tempest-keypair-712848137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsobMA6a0wADQzUZVeK7WSQc7md8nUOY4F1JbzdkVUI79TThVTnB/bkE4p7ZlbdPEvimsYN2cqF7lfm971b7UC4ji36kq0Ps3WMUhDzJ9mHeHzLfLSuBgM4ANwD9yEhPw=="}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:19.136159 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-dea2cda9-04ad-4310-b8ce-a4761f5684c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:19.136547 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-adbb778f-35a8-4040-8172-c3a31f7a0e52 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'key_pairs'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:19.137059 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-dea2cda9-04ad-4310-b8ce-a4761f5684c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:19.140851 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-adbb778f-35a8-4040-8172-c3a31f7a0e52 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for user 94c16391d39f4498a55c89bf2838788f and project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'key_pairs'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:19.144886 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dea2cda9-04ad-4310-b8ce-a4761f5684c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:19.145598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dea2cda9-04ad-4310-b8ce-a4761f5684c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:19.146927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dea2cda9-04ad-4310-b8ce-a4761f5684c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:19.147593 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dea2cda9-04ad-4310-b8ce-a4761f5684c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:19.277138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-adbb778f-35a8-4040-8172-c3a31f7a0e52 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.160219 Jul 18 02:37:19.278050 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 135/257] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 18 02:37:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:19.284925 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dea2cda9-04ad-4310-b8ce-a4761f5684c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:19.293529 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dea2cda9-04ad-4310-b8ce-a4761f5684c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:19.295163 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dea2cda9-04ad-4310-b8ce-a4761f5684c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:19.296435 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-dea2cda9-04ad-4310-b8ce-a4761f5684c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.164280 Jul 18 02:37:19.297080 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 123/258] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:19 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:20.090424 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ba90dec3-f1b5-46f7-9a3b-b6c34b91e27c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:20.091085 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ba90dec3-f1b5-46f7-9a3b-b6c34b91e27c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:20.099555 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ba90dec3-f1b5-46f7-9a3b-b6c34b91e27c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.100348 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ba90dec3-f1b5-46f7-9a3b-b6c34b91e27c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.100840 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ba90dec3-f1b5-46f7-9a3b-b6c34b91e27c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.101300 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ba90dec3-f1b5-46f7-9a3b-b6c34b91e27c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.124043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-60174b6d-f46b-4e40-90e8-1080324343f3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:20.124592 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-60174b6d-f46b-4e40-90e8-1080324343f3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:20.131145 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60174b6d-f46b-4e40-90e8-1080324343f3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.131593 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60174b6d-f46b-4e40-90e8-1080324343f3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.132359 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60174b6d-f46b-4e40-90e8-1080324343f3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.132795 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60174b6d-f46b-4e40-90e8-1080324343f3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.159082 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-60174b6d-f46b-4e40-90e8-1080324343f3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Going to try to terminate instance {{(pid=124890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:37:20.273688 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ba90dec3-f1b5-46f7-9a3b-b6c34b91e27c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:20.276345 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ba90dec3-f1b5-46f7-9a3b-b6c34b91e27c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.189847 Jul 18 02:37:20.276919 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 136/259] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:20 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:20.316677 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-75277250-1aea-42bf-b03c-e9a9e79521e6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:20.317487 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-75277250-1aea-42bf-b03c-e9a9e79521e6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:20.324496 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-75277250-1aea-42bf-b03c-e9a9e79521e6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.325155 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-75277250-1aea-42bf-b03c-e9a9e79521e6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.326122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-75277250-1aea-42bf-b03c-e9a9e79521e6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.326575 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-75277250-1aea-42bf-b03c-e9a9e79521e6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.507763 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-75277250-1aea-42bf-b03c-e9a9e79521e6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:20.515895 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-75277250-1aea-42bf-b03c-e9a9e79521e6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:20.517776 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-75277250-1aea-42bf-b03c-e9a9e79521e6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:20.519004 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-75277250-1aea-42bf-b03c-e9a9e79521e6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.207346 Jul 18 02:37:20.519574 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 137/260] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:20 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:20.575786 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-60174b6d-f46b-4e40-90e8-1080324343f3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "DELETE /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 204 len: 0 microversion: 2.1 time: 0.455193 Jul 18 02:37:20.576545 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 124/261] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:37:20 2022] DELETE /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:37:20.584557 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f30a6778-9e67-40db-a8f2-be9b7cfe469a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:20.585256 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f30a6778-9e67-40db-a8f2-be9b7cfe469a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:20.591369 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f30a6778-9e67-40db-a8f2-be9b7cfe469a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.591831 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f30a6778-9e67-40db-a8f2-be9b7cfe469a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.592597 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f30a6778-9e67-40db-a8f2-be9b7cfe469a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:20.593033 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f30a6778-9e67-40db-a8f2-be9b7cfe469a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:20.725590 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f30a6778-9e67-40db-a8f2-be9b7cfe469a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:20.733093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f30a6778-9e67-40db-a8f2-be9b7cfe469a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1502 microversion: 2.1 time: 0.152531 Jul 18 02:37:20.734625 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 138/262] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:20 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:21.293405 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bfae03aa-b5c2-4c15-b67f-aaa01e0c83d5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:21.294197 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bfae03aa-b5c2-4c15-b67f-aaa01e0c83d5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:21.301556 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bfae03aa-b5c2-4c15-b67f-aaa01e0c83d5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.302016 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bfae03aa-b5c2-4c15-b67f-aaa01e0c83d5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:21.302855 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bfae03aa-b5c2-4c15-b67f-aaa01e0c83d5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.303300 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bfae03aa-b5c2-4c15-b67f-aaa01e0c83d5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:21.457329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bfae03aa-b5c2-4c15-b67f-aaa01e0c83d5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:21.465265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bfae03aa-b5c2-4c15-b67f-aaa01e0c83d5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.176118 Jul 18 02:37:21.465830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 125/263] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:21 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:21.538066 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c65e44fd-dc03-4ed5-b0b1-37ae8af2f360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:21.538835 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c65e44fd-dc03-4ed5-b0b1-37ae8af2f360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:21.545764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c65e44fd-dc03-4ed5-b0b1-37ae8af2f360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.546250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c65e44fd-dc03-4ed5-b0b1-37ae8af2f360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:21.547000 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c65e44fd-dc03-4ed5-b0b1-37ae8af2f360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.547429 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c65e44fd-dc03-4ed5-b0b1-37ae8af2f360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:21.685164 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c65e44fd-dc03-4ed5-b0b1-37ae8af2f360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:21.694135 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c65e44fd-dc03-4ed5-b0b1-37ae8af2f360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:21.695888 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c65e44fd-dc03-4ed5-b0b1-37ae8af2f360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:21.697113 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c65e44fd-dc03-4ed5-b0b1-37ae8af2f360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.163641 Jul 18 02:37:21.697684 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 139/264] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:21 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:21.750927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3e08c83a-3155-4d8e-9c2c-ada6dad5f64d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:21.752204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3e08c83a-3155-4d8e-9c2c-ada6dad5f64d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:21.758503 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3e08c83a-3155-4d8e-9c2c-ada6dad5f64d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.758903 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3e08c83a-3155-4d8e-9c2c-ada6dad5f64d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:21.759670 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3e08c83a-3155-4d8e-9c2c-ada6dad5f64d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:21.760112 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3e08c83a-3155-4d8e-9c2c-ada6dad5f64d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:21.891722 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3e08c83a-3155-4d8e-9c2c-ada6dad5f64d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:21.895387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:21.899831 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3e08c83a-3155-4d8e-9c2c-ada6dad5f64d tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1502 microversion: 2.1 time: 0.152780 Jul 18 02:37:21.900413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 126/265] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:21 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:22.225796 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1111676643", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdc6ffcf-95a1-4f66-b96c-1c077c87b2a3"}], "security_groups": [{"name": "tempest-securitygroup--1613677305"}], "key_name": "tempest-keypair-712848137", "user_data": "}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:22.363969 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] validate_networks() for [('cdc6ffcf-95a1-4f66-b96c-1c077c87b2a3', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:37:22.481555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9f4ecc2c-9ee9-443e-8960-b6afb2c62ea9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:22.483110 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9f4ecc2c-9ee9-443e-8960-b6afb2c62ea9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:22.490461 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f4ecc2c-9ee9-443e-8960-b6afb2c62ea9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.490967 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f4ecc2c-9ee9-443e-8960-b6afb2c62ea9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.491896 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f4ecc2c-9ee9-443e-8960-b6afb2c62ea9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.492511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f4ecc2c-9ee9-443e-8960-b6afb2c62ea9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.641561 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9f4ecc2c-9ee9-443e-8960-b6afb2c62ea9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:22.649959 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9f4ecc2c-9ee9-443e-8960-b6afb2c62ea9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.172382 Jul 18 02:37:22.650569 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 127/266] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:22 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:22.717817 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d9bc8630-77df-4696-bb37-cd81c76afa9c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:22.718812 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d9bc8630-77df-4696-bb37-cd81c76afa9c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:22.730867 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d9bc8630-77df-4696-bb37-cd81c76afa9c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.731536 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d9bc8630-77df-4696-bb37-cd81c76afa9c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.732891 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d9bc8630-77df-4696-bb37-cd81c76afa9c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.733514 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d9bc8630-77df-4696-bb37-cd81c76afa9c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.899342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d9bc8630-77df-4696-bb37-cd81c76afa9c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:22.907959 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d9bc8630-77df-4696-bb37-cd81c76afa9c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:22.909634 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d9bc8630-77df-4696-bb37-cd81c76afa9c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:22.910922 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d9bc8630-77df-4696-bb37-cd81c76afa9c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.198448 Jul 18 02:37:22.922426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 128/267] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:22 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:22.931257 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bf87e7f0-510a-4bbf-a16e-fc64582a8d5b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:22.932095 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bf87e7f0-510a-4bbf-a16e-fc64582a8d5b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:22.938452 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bf87e7f0-510a-4bbf-a16e-fc64582a8d5b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.940728 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bf87e7f0-510a-4bbf-a16e-fc64582a8d5b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:22.941583 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bf87e7f0-510a-4bbf-a16e-fc64582a8d5b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:22.942029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bf87e7f0-510a-4bbf-a16e-fc64582a8d5b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.033713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:37:23.034249 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:37:23.034806 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:37:23.035078 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:37:23.035538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:37:23.045636 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.046328 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.047127 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.047558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.068864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:23.071926 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for user 94c16391d39f4498a55c89bf2838788f and project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:23.085116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:37:23.087470 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:37:23.100935 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bf87e7f0-510a-4bbf-a16e-fc64582a8d5b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:23.112465 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bf87e7f0-510a-4bbf-a16e-fc64582a8d5b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1502 microversion: 2.1 time: 0.188650 Jul 18 02:37:23.113343 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 129/268] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:22 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:23.223397 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1fb428b8-baa6-4abb-a9e2-456e46fdfb71 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.001796 Jul 18 02:37:23.223955 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 140/269] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:37:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:37:23.234099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bc82c2a2-a73b-4b2f-b7ea-77522436cf63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:23.234718 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bc82c2a2-a73b-4b2f-b7ea-77522436cf63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:23.244359 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-fcc26e48-8e10-4ddd-8362-de9712ceb030 req-02ec6e7c-e1cf-4bc0-b3d5-103447be3ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512cfd89-f539-4db2-ae0d-441520effb5e", "name": "network-vif-deleted", "tag": "58895295-26ab-4273-99a5-951870952460"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:23.257918 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-fcc26e48-8e10-4ddd-8362-de9712ceb030 req-02ec6e7c-e1cf-4bc0-b3d5-103447be3ec2 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.260374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-fcc26e48-8e10-4ddd-8362-de9712ceb030 req-02ec6e7c-e1cf-4bc0-b3d5-103447be3ec2 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.279281 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-fcc26e48-8e10-4ddd-8362-de9712ceb030 req-02ec6e7c-e1cf-4bc0-b3d5-103447be3ec2 service nova] Creating event network-vif-deleted:58895295-26ab-4273-99a5-951870952460 for instance 512cfd89-f539-4db2-ae0d-441520effb5e on hv-cinder-85001 Jul 18 02:37:23.285455 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-fcc26e48-8e10-4ddd-8362-de9712ceb030 req-02ec6e7c-e1cf-4bc0-b3d5-103447be3ec2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044752 Jul 18 02:37:23.286159 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 141/270] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:23.316250 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bc82c2a2-a73b-4b2f-b7ea-77522436cf63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:23.321271 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bc82c2a2-a73b-4b2f-b7ea-77522436cf63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1241 microversion: 2.1 time: 0.091132 Jul 18 02:37:23.321912 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 130/271] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:23 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:23.667783 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-73b9521b-cb40-49db-a32e-b678278bd004 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:23.668482 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-73b9521b-cb40-49db-a32e-b678278bd004 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:23.687284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73b9521b-cb40-49db-a32e-b678278bd004 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.687284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73b9521b-cb40-49db-a32e-b678278bd004 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.687284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73b9521b-cb40-49db-a32e-b678278bd004 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.687284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73b9521b-cb40-49db-a32e-b678278bd004 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.842815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-73b9521b-cb40-49db-a32e-b678278bd004 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:23.852619 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-73b9521b-cb40-49db-a32e-b678278bd004 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.189500 Jul 18 02:37:23.862873 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 142/272] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:23 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:23.930952 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ce3afc67-604b-4e94-aa97-b906d97a2071 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:23.931572 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-ce3afc67-604b-4e94-aa97-b906d97a2071 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:23.938928 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ce3afc67-604b-4e94-aa97-b906d97a2071 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.940023 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ce3afc67-604b-4e94-aa97-b906d97a2071 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:23.940810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ce3afc67-604b-4e94-aa97-b906d97a2071 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:23.941252 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ce3afc67-604b-4e94-aa97-b906d97a2071 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.074133 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ce3afc67-604b-4e94-aa97-b906d97a2071 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:24.082347 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ce3afc67-604b-4e94-aa97-b906d97a2071 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:24.083848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ce3afc67-604b-4e94-aa97-b906d97a2071 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:24.085006 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ce3afc67-604b-4e94-aa97-b906d97a2071 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.158006 Jul 18 02:37:24.085620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 131/273] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:23 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:24.130751 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:24.131364 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:24.137339 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.137785 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.138574 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.139008 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.172584 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.173258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.174208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lazy-loading 'fault' on Instance uuid 512cfd89-f539-4db2-ae0d-441520effb5e {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:24.219628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:24.229632 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2737bb19-c72a-4204-8c4f-849782691d9a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1302 microversion: 2.1 time: 0.103537 Jul 18 02:37:24.230118 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 143/274] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:24 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:24.337693 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3ad141b1-1b4b-4442-88cd-d07fcc8e11ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:24.338446 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3ad141b1-1b4b-4442-88cd-d07fcc8e11ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:24.344578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ad141b1-1b4b-4442-88cd-d07fcc8e11ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.345250 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ad141b1-1b4b-4442-88cd-d07fcc8e11ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.346746 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ad141b1-1b4b-4442-88cd-d07fcc8e11ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.347306 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ad141b1-1b4b-4442-88cd-d07fcc8e11ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.418744 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3ad141b1-1b4b-4442-88cd-d07fcc8e11ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:24.428520 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3ad141b1-1b4b-4442-88cd-d07fcc8e11ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1245 microversion: 2.1 time: 0.094589 Jul 18 02:37:24.429370 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 132/275] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:24 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:24.870728 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bbf802d5-6a69-41b6-b814-6bd29130c866 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:24.871185 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bbf802d5-6a69-41b6-b814-6bd29130c866 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:24.877682 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bbf802d5-6a69-41b6-b814-6bd29130c866 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.878163 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bbf802d5-6a69-41b6-b814-6bd29130c866 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:24.878921 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bbf802d5-6a69-41b6-b814-6bd29130c866 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:24.879350 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bbf802d5-6a69-41b6-b814-6bd29130c866 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.016992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bbf802d5-6a69-41b6-b814-6bd29130c866 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:25.025146 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bbf802d5-6a69-41b6-b814-6bd29130c866 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1520 microversion: 2.1 time: 0.158400 Jul 18 02:37:25.025709 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 144/276] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:24 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:25.104076 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7b94faf7-a582-47c5-87e3-ccabae6e76a9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:25.104680 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7b94faf7-a582-47c5-87e3-ccabae6e76a9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:25.112224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7b94faf7-a582-47c5-87e3-ccabae6e76a9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.115099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7b94faf7-a582-47c5-87e3-ccabae6e76a9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.115099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7b94faf7-a582-47c5-87e3-ccabae6e76a9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.115099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7b94faf7-a582-47c5-87e3-ccabae6e76a9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.247290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:25.248144 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:25.255236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.255513 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7b94faf7-a582-47c5-87e3-ccabae6e76a9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:25.255734 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.256459 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.256891 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.265882 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7b94faf7-a582-47c5-87e3-ccabae6e76a9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:25.269183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7b94faf7-a582-47c5-87e3-ccabae6e76a9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:25.271032 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7b94faf7-a582-47c5-87e3-ccabae6e76a9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.170782 Jul 18 02:37:25.271607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 133/277] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:25 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:25.294856 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.295322 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.295765 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lazy-loading 'fault' on Instance uuid 512cfd89-f539-4db2-ae0d-441520effb5e {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:25.337693 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:25.345843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9d823573-67cc-465f-9e5b-fdedc95f73f1 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1302 microversion: 2.1 time: 0.102459 Jul 18 02:37:25.346913 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 145/278] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:25 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1302 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:25.445729 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-794a249b-adb8-421f-ad57-1f500b208aec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:25.446309 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-794a249b-adb8-421f-ad57-1f500b208aec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:25.452408 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-794a249b-adb8-421f-ad57-1f500b208aec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.452854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-794a249b-adb8-421f-ad57-1f500b208aec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.453642 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-794a249b-adb8-421f-ad57-1f500b208aec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:25.454078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-794a249b-adb8-421f-ad57-1f500b208aec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:25.521250 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-794a249b-adb8-421f-ad57-1f500b208aec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:25.529436 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-794a249b-adb8-421f-ad57-1f500b208aec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1237 microversion: 2.1 time: 0.087624 Jul 18 02:37:25.530049 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 134/279] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:25 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:26.042726 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b8c30ff2-2b24-4888-86c1-b10abdd1da1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:26.043253 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b8c30ff2-2b24-4888-86c1-b10abdd1da1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.049756 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b8c30ff2-2b24-4888-86c1-b10abdd1da1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.050247 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b8c30ff2-2b24-4888-86c1-b10abdd1da1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.051009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b8c30ff2-2b24-4888-86c1-b10abdd1da1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.051446 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b8c30ff2-2b24-4888-86c1-b10abdd1da1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.192453 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b8c30ff2-2b24-4888-86c1-b10abdd1da1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.200549 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b8c30ff2-2b24-4888-86c1-b10abdd1da1c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1500 microversion: 2.1 time: 0.161751 Jul 18 02:37:26.208091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 146/280] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:26 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:26.216613 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-98dee211-829b-4f27-895a-c974663689d2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:26.217224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-98dee211-829b-4f27-895a-c974663689d2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.224270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98dee211-829b-4f27-895a-c974663689d2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.224720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98dee211-829b-4f27-895a-c974663689d2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.225482 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98dee211-829b-4f27-895a-c974663689d2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.225914 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98dee211-829b-4f27-895a-c974663689d2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.289883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-af8497a6-0708-4261-b32c-9850bc604b3e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:26.290663 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-af8497a6-0708-4261-b32c-9850bc604b3e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.305697 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-af8497a6-0708-4261-b32c-9850bc604b3e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.305697 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-af8497a6-0708-4261-b32c-9850bc604b3e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.305697 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-af8497a6-0708-4261-b32c-9850bc604b3e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.305697 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-af8497a6-0708-4261-b32c-9850bc604b3e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.387125 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-98dee211-829b-4f27-895a-c974663689d2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.395653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-98dee211-829b-4f27-895a-c974663689d2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1515 microversion: 2.1 time: 0.182733 Jul 18 02:37:26.396533 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 135/281] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:26 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:26.406398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:26.406398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.410207 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.410671 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.411453 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.411899 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.447474 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.447977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.448768 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lazy-loading 'fault' on Instance uuid 512cfd89-f539-4db2-ae0d-441520effb5e {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:26.456549 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-af8497a6-0708-4261-b32c-9850bc604b3e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.465059 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-af8497a6-0708-4261-b32c-9850bc604b3e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.466928 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-af8497a6-0708-4261-b32c-9850bc604b3e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.468295 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-af8497a6-0708-4261-b32c-9850bc604b3e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.182623 Jul 18 02:37:26.468888 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 147/282] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:26 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:26.511002 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.520145 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4af49b5c-fb0b-4928-87fe-508b1bf7958a tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 200 len: 1302 microversion: 2.1 time: 0.122547 Jul 18 02:37:26.520898 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 136/283] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:26 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:26.547472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3892d543-c3cc-4736-8d5b-2c939472030d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:26.548180 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3892d543-c3cc-4736-8d5b-2c939472030d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:26.555576 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3892d543-c3cc-4736-8d5b-2c939472030d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.556096 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3892d543-c3cc-4736-8d5b-2c939472030d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.557060 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3892d543-c3cc-4736-8d5b-2c939472030d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:26.557496 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3892d543-c3cc-4736-8d5b-2c939472030d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:26.619749 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3892d543-c3cc-4736-8d5b-2c939472030d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:26.627309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3892d543-c3cc-4736-8d5b-2c939472030d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1293 microversion: 2.1 time: 0.084104 Jul 18 02:37:26.627895 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 148/284] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:26 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:27.488791 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7eedaa90-c156-4350-b06b-8384b80adff9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:27.490781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7eedaa90-c156-4350-b06b-8384b80adff9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:27.498344 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7eedaa90-c156-4350-b06b-8384b80adff9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.499662 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7eedaa90-c156-4350-b06b-8384b80adff9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.500661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7eedaa90-c156-4350-b06b-8384b80adff9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.501100 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7eedaa90-c156-4350-b06b-8384b80adff9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.537317 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e872cb50-bde4-4893-b07e-d40eaf830488 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:27.538699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e872cb50-bde4-4893-b07e-d40eaf830488 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 512cfd89-f539-4db2-ae0d-441520effb5e] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:27.554780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e872cb50-bde4-4893-b07e-d40eaf830488 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.555817 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e872cb50-bde4-4893-b07e-d40eaf830488 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.556735 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e872cb50-bde4-4893-b07e-d40eaf830488 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.557312 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e872cb50-bde4-4893-b07e-d40eaf830488 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.560524 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:27.574017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-e872cb50-bde4-4893-b07e-d40eaf830488 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] HTTP exception thrown: Instance 512cfd89-f539-4db2-ae0d-441520effb5e could not be found. Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e872cb50-bde4-4893-b07e-d40eaf830488 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Request method failure captured: Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e HTTP/1.1 Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MdFCCg1I9ms6pEPQym6EPsQAmqAnsOKttRtW6OvcEVzw1hp-I8fjZVf4ofWCrClUI5RaJ2GqKIxKx5rVOaGOctVYKiC6Q-VLt2tZBPQXd7o35xwSFXOMqrbFrlzEMoq4p4grNWiNqF7VACjlMWIbqE8CT3uymzSdJmlIIPtAOgRMSA Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: d615520de8a64205981c88430498f5f6 Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesActionsTest-874403558 Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:37:27.577963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d615520de8a64205981c88430498f5f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d615520de8a64205981c88430498f5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d615520de8a64205981c88430498f5f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d615520de8a64205981c88430498f5f6", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesActionsTest-874403558 Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: d615520de8a64205981c88430498f5f6 Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesActionsTest-874403558 Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesActionsTest-874403558-project Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 86d9949aaf5749c9b00e1e04171e6f93 Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesActionsTest-874403558-project Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 512cfd89-f539-4db2-ae0d-441520effb5e could not be found. Jul 18 02:37:27.582815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '512cfd89-f539-4db2-ae0d-441520effb5e'} Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512cfd89-f539-4db2-ae0d-441520effb5e could not be found. Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:27.583686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512cfd89-f539-4db2-ae0d-441520effb5e could not be found. Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512cfd89-f539-4db2-ae0d-441520effb5e could not be found. Jul 18 02:37:27.585121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:37:27.586438 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e872cb50-bde4-4893-b07e-d40eaf830488 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Returning 404 to user: Instance 512cfd89-f539-4db2-ae0d-441520effb5e could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:27.586438 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e872cb50-bde4-4893-b07e-d40eaf830488 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e" status: 404 len: 111 microversion: 2.1 time: 0.043677 Jul 18 02:37:27.586438 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 149/285] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:27 2022] GET /compute/v2.1/servers/512cfd89-f539-4db2-ae0d-441520effb5e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:37:27.643611 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-65cf2943-b146-44a4-b3a2-81dca6f23600 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:27.644175 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-65cf2943-b146-44a4-b3a2-81dca6f23600 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:27.646038 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:27.651199 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65cf2943-b146-44a4-b3a2-81dca6f23600 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.652230 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65cf2943-b146-44a4-b3a2-81dca6f23600 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.653017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65cf2943-b146-44a4-b3a2-81dca6f23600 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:27.653459 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65cf2943-b146-44a4-b3a2-81dca6f23600 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:27.715991 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7eedaa90-c156-4350-b06b-8384b80adff9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:27.724484 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7eedaa90-c156-4350-b06b-8384b80adff9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:27.726263 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7eedaa90-c156-4350-b06b-8384b80adff9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:27.727629 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7eedaa90-c156-4350-b06b-8384b80adff9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.243947 Jul 18 02:37:27.728349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 137/286] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:27 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:27.753353 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1657992748", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "networks": [{"uuid": "751f7927-6223-4192-b4ba-501ca0955707"}]}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:27.795206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-65cf2943-b146-44a4-b3a2-81dca6f23600 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:27.804020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-65cf2943-b146-44a4-b3a2-81dca6f23600 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1301 microversion: 2.1 time: 0.164193 Jul 18 02:37:27.804804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 150/287] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:27 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1301 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:27.807582 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.network.neutron [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] validate_networks() for [('751f7927-6223-4192-b4ba-501ca0955707', None, None, None, None, None)] {{(pid=124890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:37:28.069681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-745ed32a-2dca-47a5-8f86-37edb4d80f06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:28.084914 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-745ed32a-2dca-47a5-8f86-37edb4d80f06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.088977 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-745ed32a-2dca-47a5-8f86-37edb4d80f06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.161588 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-745ed32a-2dca-47a5-8f86-37edb4d80f06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Going to try to stop instance {{(pid=124891) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:37:28.275467 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Flavor limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:37:28.276018 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Image limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:37:28.276962 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Flavor pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:37:28.277491 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Image pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:37:28.278345 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:37:28.294003 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.295194 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.302409 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.302409 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.320398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Getting quotas for project d615520de8a64205981c88430498f5f6. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:28.333982 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Getting quotas for user 86d9949aaf5749c9b00e1e04171e6f93 and project d615520de8a64205981c88430498f5f6. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:28.347729 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Going to run 1 instances... {{(pid=124890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:37:28.350801 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:37:28.363770 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:28.452373 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-745ed32a-2dca-47a5-8f86-37edb4d80f06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/action" status: 202 len: 0 microversion: 2.1 time: 0.386143 Jul 18 02:37:28.453072 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 151/288] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:37:28 2022] POST /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:37:28.462989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b37bd434-f274-4046-97ac-77e6370e17c3 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713597 Jul 18 02:37:28.468364 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 138/289] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:37:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:37:28.469118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1c6049f3-24a9-4e95-b831-dd0ba5e34a9c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:28.469736 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1c6049f3-24a9-4e95-b831-dd0ba5e34a9c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:28.479908 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8eb64fd2-cbfa-435f-8a81-a0ecc02f0117 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:28.480523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c6049f3-24a9-4e95-b831-dd0ba5e34a9c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.481191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c6049f3-24a9-4e95-b831-dd0ba5e34a9c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.481843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8eb64fd2-cbfa-435f-8a81-a0ecc02f0117 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:28.482221 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c6049f3-24a9-4e95-b831-dd0ba5e34a9c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.482672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c6049f3-24a9-4e95-b831-dd0ba5e34a9c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.489981 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8eb64fd2-cbfa-435f-8a81-a0ecc02f0117 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.490816 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8eb64fd2-cbfa-435f-8a81-a0ecc02f0117 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.491827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8eb64fd2-cbfa-435f-8a81-a0ecc02f0117 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.492329 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8eb64fd2-cbfa-435f-8a81-a0ecc02f0117 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.714209 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1c6049f3-24a9-4e95-b831-dd0ba5e34a9c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:28.726662 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1c6049f3-24a9-4e95-b831-dd0ba5e34a9c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.261539 Jul 18 02:37:28.727514 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 139/290] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:28 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:28.729993 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-8eb64fd2-cbfa-435f-8a81-a0ecc02f0117 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lazy-loading 'flavor' on Instance uuid 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:28.746202 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-31954a49-1fd0-4ab9-b2b5-2bd939e252af tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:28.746945 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-31954a49-1fd0-4ab9-b2b5-2bd939e252af tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:28.820459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-31954a49-1fd0-4ab9-b2b5-2bd939e252af tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:28.828840 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-31954a49-1fd0-4ab9-b2b5-2bd939e252af tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1214 microversion: 2.1 time: 0.088923 Jul 18 02:37:28.830146 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 140/291] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:28 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:28.839700 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-585cff8e-7ff2-4941-bda2-f2a46ed5c45d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:28.840615 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-585cff8e-7ff2-4941-bda2-f2a46ed5c45d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:28.848324 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-585cff8e-7ff2-4941-bda2-f2a46ed5c45d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.848875 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-585cff8e-7ff2-4941-bda2-f2a46ed5c45d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:28.849932 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-585cff8e-7ff2-4941-bda2-f2a46ed5c45d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:28.850618 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-585cff8e-7ff2-4941-bda2-f2a46ed5c45d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.033523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-585cff8e-7ff2-4941-bda2-f2a46ed5c45d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.043418 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-585cff8e-7ff2-4941-bda2-f2a46ed5c45d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.045511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-585cff8e-7ff2-4941-bda2-f2a46ed5c45d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.047179 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-585cff8e-7ff2-4941-bda2-f2a46ed5c45d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.214898 Jul 18 02:37:29.048295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 141/292] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:28 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:29.054102 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8d2ca4d9-d3e3-40c1-87bd-c7273ad310f1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:29.055061 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8d2ca4d9-d3e3-40c1-87bd-c7273ad310f1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:29.063897 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8d2ca4d9-d3e3-40c1-87bd-c7273ad310f1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.068432 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8d2ca4d9-d3e3-40c1-87bd-c7273ad310f1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.068432 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8d2ca4d9-d3e3-40c1-87bd-c7273ad310f1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.068432 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8d2ca4d9-d3e3-40c1-87bd-c7273ad310f1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.185229 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8eb64fd2-cbfa-435f-8a81-a0ecc02f0117 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8/action" status: 200 len: 32 microversion: 2.1 time: 0.729932 Jul 18 02:37:29.187663 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 152/293] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:37:28 2022] POST /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8/action => generated 32 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:37:29.197390 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e4ff7976-855e-44cf-8d46-df3bbb6c52c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:29.197960 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e4ff7976-855e-44cf-8d46-df3bbb6c52c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:29.216243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e4ff7976-855e-44cf-8d46-df3bbb6c52c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.216243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e4ff7976-855e-44cf-8d46-df3bbb6c52c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.216243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e4ff7976-855e-44cf-8d46-df3bbb6c52c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.216243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e4ff7976-855e-44cf-8d46-df3bbb6c52c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.280254 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8d2ca4d9-d3e3-40c1-87bd-c7273ad310f1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.290893 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8d2ca4d9-d3e3-40c1-87bd-c7273ad310f1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1367 microversion: 2.1 time: 0.240880 Jul 18 02:37:29.291742 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 142/294] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:29 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:29.745856 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-99432365-ae89-40e9-af28-21edfc76a364 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:29.747386 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-99432365-ae89-40e9-af28-21edfc76a364 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:29.759650 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-99432365-ae89-40e9-af28-21edfc76a364 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.763097 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-99432365-ae89-40e9-af28-21edfc76a364 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.764163 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-99432365-ae89-40e9-af28-21edfc76a364 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.764709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-99432365-ae89-40e9-af28-21edfc76a364 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.892020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e4ff7976-855e-44cf-8d46-df3bbb6c52c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.907030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e4ff7976-855e-44cf-8d46-df3bbb6c52c9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.714176 Jul 18 02:37:29.919602 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 153/295] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:29 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:29.925450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-985861c1-9c22-4b0f-844e-a426ae96cc0e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:29.926424 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-985861c1-9c22-4b0f-844e-a426ae96cc0e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:29.931196 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-99432365-ae89-40e9-af28-21edfc76a364 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:29.933749 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-985861c1-9c22-4b0f-844e-a426ae96cc0e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.935566 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-985861c1-9c22-4b0f-844e-a426ae96cc0e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.937812 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-985861c1-9c22-4b0f-844e-a426ae96cc0e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:29.938386 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-985861c1-9c22-4b0f-844e-a426ae96cc0e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:29.941601 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-99432365-ae89-40e9-af28-21edfc76a364 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.200387 Jul 18 02:37:29.942204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 143/296] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:29 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:30.064852 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7df8717f-5715-4aad-a194-6ea922965495 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:30.069270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7df8717f-5715-4aad-a194-6ea922965495 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:30.072238 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7df8717f-5715-4aad-a194-6ea922965495 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.072689 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7df8717f-5715-4aad-a194-6ea922965495 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.073458 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7df8717f-5715-4aad-a194-6ea922965495 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.073888 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7df8717f-5715-4aad-a194-6ea922965495 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.164026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-985861c1-9c22-4b0f-844e-a426ae96cc0e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:30.177010 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-985861c1-9c22-4b0f-844e-a426ae96cc0e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1218 microversion: 2.1 time: 0.255209 Jul 18 02:37:30.180392 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 154/297] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:29 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1218 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:30.256530 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7df8717f-5715-4aad-a194-6ea922965495 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:30.272422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7df8717f-5715-4aad-a194-6ea922965495 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:30.277704 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7df8717f-5715-4aad-a194-6ea922965495 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:30.277704 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7df8717f-5715-4aad-a194-6ea922965495 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1745 microversion: 2.20 time: 0.214828 Jul 18 02:37:30.277704 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 144/298] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:30 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1745 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:30.315981 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6ce91609-b32a-485d-9e70-a6ba21f6876c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:30.316740 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6ce91609-b32a-485d-9e70-a6ba21f6876c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:30.324872 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ce91609-b32a-485d-9e70-a6ba21f6876c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.325571 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ce91609-b32a-485d-9e70-a6ba21f6876c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.326500 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ce91609-b32a-485d-9e70-a6ba21f6876c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.326934 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ce91609-b32a-485d-9e70-a6ba21f6876c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.685523 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6ce91609-b32a-485d-9e70-a6ba21f6876c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:30.699115 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6ce91609-b32a-485d-9e70-a6ba21f6876c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1367 microversion: 2.1 time: 0.388640 Jul 18 02:37:30.700172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 155/299] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:30 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:30.925567 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-83692311-dde3-4de0-a082-370ab318e7a9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:30.926354 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-83692311-dde3-4de0-a082-370ab318e7a9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:30.933632 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83692311-dde3-4de0-a082-370ab318e7a9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.934288 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83692311-dde3-4de0-a082-370ab318e7a9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.935162 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83692311-dde3-4de0-a082-370ab318e7a9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.935672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83692311-dde3-4de0-a082-370ab318e7a9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.961402 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-855ce1b1-01e1-4253-8d55-6b136a994cdd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:30.963905 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-855ce1b1-01e1-4253-8d55-6b136a994cdd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:30.976824 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-855ce1b1-01e1-4253-8d55-6b136a994cdd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.977487 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-855ce1b1-01e1-4253-8d55-6b136a994cdd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:30.979241 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-855ce1b1-01e1-4253-8d55-6b136a994cdd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:30.979976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-855ce1b1-01e1-4253-8d55-6b136a994cdd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.109718 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-83692311-dde3-4de0-a082-370ab318e7a9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:31.113176 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:31.117726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-83692311-dde3-4de0-a082-370ab318e7a9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.196699 Jul 18 02:37:31.118420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 145/300] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:30 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:31.194546 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c48c41d7-d107-4ca3-8f02-8d95548eaf1e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:31.195900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c48c41d7-d107-4ca3-8f02-8d95548eaf1e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:31.202079 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c48c41d7-d107-4ca3-8f02-8d95548eaf1e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.202817 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c48c41d7-d107-4ca3-8f02-8d95548eaf1e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.203639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c48c41d7-d107-4ca3-8f02-8d95548eaf1e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.204072 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c48c41d7-d107-4ca3-8f02-8d95548eaf1e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.241215 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-855ce1b1-01e1-4253-8d55-6b136a994cdd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:31.251460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-855ce1b1-01e1-4253-8d55-6b136a994cdd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.296532 Jul 18 02:37:31.252264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 156/301] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:30 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:31.272188 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c48c41d7-d107-4ca3-8f02-8d95548eaf1e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:31.279847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c48c41d7-d107-4ca3-8f02-8d95548eaf1e tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1266 microversion: 2.1 time: 0.089611 Jul 18 02:37:31.280427 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 146/302] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:31 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:31.300278 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4445646f-7cb5-40a0-b4bf-cad2a51bd198 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:31.300994 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4445646f-7cb5-40a0-b4bf-cad2a51bd198 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:31.308617 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4445646f-7cb5-40a0-b4bf-cad2a51bd198 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.309177 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4445646f-7cb5-40a0-b4bf-cad2a51bd198 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.310038 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4445646f-7cb5-40a0-b4bf-cad2a51bd198 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.310596 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4445646f-7cb5-40a0-b4bf-cad2a51bd198 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.716855 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f83f075d-bae2-4dc5-afd5-f4c6a4902ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:31.724510 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f83f075d-bae2-4dc5-afd5-f4c6a4902ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:31.732220 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f83f075d-bae2-4dc5-afd5-f4c6a4902ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.741696 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f83f075d-bae2-4dc5-afd5-f4c6a4902ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.742687 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f83f075d-bae2-4dc5-afd5-f4c6a4902ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.743249 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f83f075d-bae2-4dc5-afd5-f4c6a4902ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:31.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f83f075d-bae2-4dc5-afd5-f4c6a4902ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:31.898513 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f83f075d-bae2-4dc5-afd5-f4c6a4902ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1367 microversion: 2.1 time: 0.185083 Jul 18 02:37:31.899240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 147/303] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:31 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:31.978530 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-6bbbef6b-2263-4164-9cd5-64d15b6a6ce9 req-6978e1ea-ed23-4479-aa6d-f79accb4799b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b66be0c-5ad3-410b-94f2-74110dcffc9b", "tag": "0722fc37-f557-4503-a3a5-66878f8d3c27"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:31.989249 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4445646f-7cb5-40a0-b4bf-cad2a51bd198 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:31.990077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-6bbbef6b-2263-4164-9cd5-64d15b6a6ce9 req-6978e1ea-ed23-4479-aa6d-f79accb4799b service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:31.990788 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-6bbbef6b-2263-4164-9cd5-64d15b6a6ce9 req-6978e1ea-ed23-4479-aa6d-f79accb4799b service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.000921 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4445646f-7cb5-40a0-b4bf-cad2a51bd198 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:32.002864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4445646f-7cb5-40a0-b4bf-cad2a51bd198 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:32.004245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4445646f-7cb5-40a0-b4bf-cad2a51bd198 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1745 microversion: 2.20 time: 0.712971 Jul 18 02:37:32.005108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 157/304] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:31 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1745 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:32.005981 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-6bbbef6b-2263-4164-9cd5-64d15b6a6ce9 req-6978e1ea-ed23-4479-aa6d-f79accb4799b service nova] Creating event network-changed:0722fc37-f557-4503-a3a5-66878f8d3c27 for instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b on hv-cinder-85001 Jul 18 02:37:32.020204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-6bbbef6b-2263-4164-9cd5-64d15b6a6ce9 req-6978e1ea-ed23-4479-aa6d-f79accb4799b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045702 Jul 18 02:37:32.020810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 148/305] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:32.136640 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7f57f310-ead3-4726-a0bc-b396c352afa2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:32.137487 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7f57f310-ead3-4726-a0bc-b396c352afa2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:32.147169 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7f57f310-ead3-4726-a0bc-b396c352afa2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.147625 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7f57f310-ead3-4726-a0bc-b396c352afa2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.148786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7f57f310-ead3-4726-a0bc-b396c352afa2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.149446 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7f57f310-ead3-4726-a0bc-b396c352afa2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.270557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-53893ea8-b690-476d-a3c4-05216de3ead5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:32.271333 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-53893ea8-b690-476d-a3c4-05216de3ead5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:32.277478 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53893ea8-b690-476d-a3c4-05216de3ead5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.277926 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53893ea8-b690-476d-a3c4-05216de3ead5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.278714 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53893ea8-b690-476d-a3c4-05216de3ead5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.279144 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53893ea8-b690-476d-a3c4-05216de3ead5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.428472 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-53893ea8-b690-476d-a3c4-05216de3ead5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:32.438855 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-53893ea8-b690-476d-a3c4-05216de3ead5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.173642 Jul 18 02:37:32.440023 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 149/306] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:32 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:32.445557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2a33030c-52ab-4aa4-a4ce-5d173e46a7be tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:32.446179 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2a33030c-52ab-4aa4-a4ce-5d173e46a7be tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:32.452607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a33030c-52ab-4aa4-a4ce-5d173e46a7be tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.453048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a33030c-52ab-4aa4-a4ce-5d173e46a7be tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.453805 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a33030c-52ab-4aa4-a4ce-5d173e46a7be tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.454265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a33030c-52ab-4aa4-a4ce-5d173e46a7be tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.532120 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2a33030c-52ab-4aa4-a4ce-5d173e46a7be tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:32.538059 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7f57f310-ead3-4726-a0bc-b396c352afa2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:32.544683 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2a33030c-52ab-4aa4-a4ce-5d173e46a7be tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1272 microversion: 2.1 time: 0.102772 Jul 18 02:37:32.545508 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 150/307] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:32 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:32.548252 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7f57f310-ead3-4726-a0bc-b396c352afa2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.416174 Jul 18 02:37:32.548823 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 158/308] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:32 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:32.916214 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fd24488b-45f9-41cf-a338-c7dd04b0904d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:32.916830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fd24488b-45f9-41cf-a338-c7dd04b0904d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:32.922975 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fd24488b-45f9-41cf-a338-c7dd04b0904d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.923503 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fd24488b-45f9-41cf-a338-c7dd04b0904d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:32.924278 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fd24488b-45f9-41cf-a338-c7dd04b0904d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:32.925316 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fd24488b-45f9-41cf-a338-c7dd04b0904d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.022953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-547867eb-31c2-4722-b9a9-7d6488deca7e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:33.024635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-547867eb-31c2-4722-b9a9-7d6488deca7e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:33.032907 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-547867eb-31c2-4722-b9a9-7d6488deca7e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.033616 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-547867eb-31c2-4722-b9a9-7d6488deca7e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.035120 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-547867eb-31c2-4722-b9a9-7d6488deca7e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.035963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-547867eb-31c2-4722-b9a9-7d6488deca7e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.060425 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:33.082832 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=10 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:33.378746 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fd24488b-45f9-41cf-a338-c7dd04b0904d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:33.393288 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fd24488b-45f9-41cf-a338-c7dd04b0904d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1367 microversion: 2.1 time: 0.480325 Jul 18 02:37:33.398952 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 151/309] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:32 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:33.406798 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-547867eb-31c2-4722-b9a9-7d6488deca7e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:33.429364 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-547867eb-31c2-4722-b9a9-7d6488deca7e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:33.430914 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-547867eb-31c2-4722-b9a9-7d6488deca7e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:33.442593 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-547867eb-31c2-4722-b9a9-7d6488deca7e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.422826 Jul 18 02:37:33.462320 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bed9171f-7245-492c-b8c1-e6e18b1928f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:33.462752 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 159/310] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:33 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:33.462948 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bed9171f-7245-492c-b8c1-e6e18b1928f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:33.475008 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bed9171f-7245-492c-b8c1-e6e18b1928f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.475842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bed9171f-7245-492c-b8c1-e6e18b1928f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.476662 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bed9171f-7245-492c-b8c1-e6e18b1928f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.477110 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bed9171f-7245-492c-b8c1-e6e18b1928f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.569764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e1df20c8-e15b-44a3-ac3a-c0126894f61c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:33.570519 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e1df20c8-e15b-44a3-ac3a-c0126894f61c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:33.590758 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e1df20c8-e15b-44a3-ac3a-c0126894f61c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.591211 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e1df20c8-e15b-44a3-ac3a-c0126894f61c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.596282 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e1df20c8-e15b-44a3-ac3a-c0126894f61c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.607225 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e1df20c8-e15b-44a3-ac3a-c0126894f61c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.883956 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e1df20c8-e15b-44a3-ac3a-c0126894f61c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:33.894063 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e1df20c8-e15b-44a3-ac3a-c0126894f61c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.333408 Jul 18 02:37:33.905516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 160/311] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:33 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:33.911268 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1da02a09-f7c8-4338-95e1-db73cf7725a4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:33.911928 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1da02a09-f7c8-4338-95e1-db73cf7725a4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:33.920416 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1da02a09-f7c8-4338-95e1-db73cf7725a4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.920969 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1da02a09-f7c8-4338-95e1-db73cf7725a4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:33.922570 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1da02a09-f7c8-4338-95e1-db73cf7725a4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:33.923466 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1da02a09-f7c8-4338-95e1-db73cf7725a4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:34.086467 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bed9171f-7245-492c-b8c1-e6e18b1928f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:34.101479 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bed9171f-7245-492c-b8c1-e6e18b1928f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.647814 Jul 18 02:37:34.102466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 152/312] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:33 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:34.320046 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1da02a09-f7c8-4338-95e1-db73cf7725a4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:34.330894 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1da02a09-f7c8-4338-95e1-db73cf7725a4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.422447 Jul 18 02:37:34.330894 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 161/313] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:33 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:34.411262 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7c11f01a-f0b6-434e-be89-b929ef59bff0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:34.415371 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7c11f01a-f0b6-434e-be89-b929ef59bff0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:34.427255 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7c11f01a-f0b6-434e-be89-b929ef59bff0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:34.430256 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7c11f01a-f0b6-434e-be89-b929ef59bff0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:34.431299 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7c11f01a-f0b6-434e-be89-b929ef59bff0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:34.432304 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7c11f01a-f0b6-434e-be89-b929ef59bff0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:34.467701 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-26e65391-bb3f-46f7-b698-dce050b76f0b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:34.468306 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-26e65391-bb3f-46f7-b698-dce050b76f0b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:34.485261 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-26e65391-bb3f-46f7-b698-dce050b76f0b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:34.485710 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-26e65391-bb3f-46f7-b698-dce050b76f0b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:34.486710 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-26e65391-bb3f-46f7-b698-dce050b76f0b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:34.487140 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-26e65391-bb3f-46f7-b698-dce050b76f0b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:34.722431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7c11f01a-f0b6-434e-be89-b929ef59bff0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:34.731641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7c11f01a-f0b6-434e-be89-b929ef59bff0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1367 microversion: 2.1 time: 0.325192 Jul 18 02:37:34.736813 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 153/314] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:34 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:34.801675 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-26e65391-bb3f-46f7-b698-dce050b76f0b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:34.811803 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-26e65391-bb3f-46f7-b698-dce050b76f0b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:34.824902 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-26e65391-bb3f-46f7-b698-dce050b76f0b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:34.824902 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-26e65391-bb3f-46f7-b698-dce050b76f0b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.358267 Jul 18 02:37:34.824902 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 162/315] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:34 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:34.913596 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1611f52d-358c-4451-9aa1-bc3997ce2b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:34.916575 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1611f52d-358c-4451-9aa1-bc3997ce2b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:34.931420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1611f52d-358c-4451-9aa1-bc3997ce2b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:34.931953 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1611f52d-358c-4451-9aa1-bc3997ce2b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:34.932700 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1611f52d-358c-4451-9aa1-bc3997ce2b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:34.938419 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1611f52d-358c-4451-9aa1-bc3997ce2b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.125592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-c7ea93ef-dc7e-482f-9c50-b597cd10fcfb req-93c92470-22dd-4dc8-a12b-f15be9f036d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d974b9-4abf-4d7f-bbea-08e8fef381dd", "name": "network-vif-plugged", "status": "completed", "tag": "3185ab6e-a508-4ad1-b269-07229430860b"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:35.170755 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-c7ea93ef-dc7e-482f-9c50-b597cd10fcfb req-93c92470-22dd-4dc8-a12b-f15be9f036d9 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.177787 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-c7ea93ef-dc7e-482f-9c50-b597cd10fcfb req-93c92470-22dd-4dc8-a12b-f15be9f036d9 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.206215 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-c7ea93ef-dc7e-482f-9c50-b597cd10fcfb req-93c92470-22dd-4dc8-a12b-f15be9f036d9 service nova] Creating event network-vif-plugged:3185ab6e-a508-4ad1-b269-07229430860b for instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd on hv-cinder-85001 Jul 18 02:37:35.219497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-c7ea93ef-dc7e-482f-9c50-b597cd10fcfb req-93c92470-22dd-4dc8-a12b-f15be9f036d9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110055 Jul 18 02:37:35.220675 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 163/316] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:35.230905 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-53df64bf-3ced-405f-bbdf-8c4012df279c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:35.236967 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-53df64bf-3ced-405f-bbdf-8c4012df279c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:35.252268 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-53df64bf-3ced-405f-bbdf-8c4012df279c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.256385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-53df64bf-3ced-405f-bbdf-8c4012df279c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.257065 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-53df64bf-3ced-405f-bbdf-8c4012df279c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.258004 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-53df64bf-3ced-405f-bbdf-8c4012df279c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.263620 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:35.359818 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1611f52d-358c-4451-9aa1-bc3997ce2b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:35.376716 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1611f52d-358c-4451-9aa1-bc3997ce2b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.468892 Jul 18 02:37:35.380206 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 154/317] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:34 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:35.395328 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-793659b0-aaae-46c8-8e00-e0f93bed613a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:35.396042 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-793659b0-aaae-46c8-8e00-e0f93bed613a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:35.412508 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-793659b0-aaae-46c8-8e00-e0f93bed613a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.417055 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-793659b0-aaae-46c8-8e00-e0f93bed613a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.417055 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-793659b0-aaae-46c8-8e00-e0f93bed613a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.417055 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-793659b0-aaae-46c8-8e00-e0f93bed613a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.780740 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-793659b0-aaae-46c8-8e00-e0f93bed613a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:35.797901 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-793659b0-aaae-46c8-8e00-e0f93bed613a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.413923 Jul 18 02:37:35.799157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 155/318] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:35 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:35.813337 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8a67792c-2083-4cb7-9ffb-000df785eae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:35.826297 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8a67792c-2083-4cb7-9ffb-000df785eae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:35.847050 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a67792c-2083-4cb7-9ffb-000df785eae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.850346 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a67792c-2083-4cb7-9ffb-000df785eae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.851427 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a67792c-2083-4cb7-9ffb-000df785eae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.852063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a67792c-2083-4cb7-9ffb-000df785eae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.881936 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-53df64bf-3ced-405f-bbdf-8c4012df279c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:35.894130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-53df64bf-3ced-405f-bbdf-8c4012df279c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.670001 Jul 18 02:37:35.895540 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 164/319] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:35 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:35.901854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1cc0e062-21a7-425d-96b8-a6ee7ef33ac8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:35.902774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1cc0e062-21a7-425d-96b8-a6ee7ef33ac8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:35.920543 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1cc0e062-21a7-425d-96b8-a6ee7ef33ac8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.927976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1cc0e062-21a7-425d-96b8-a6ee7ef33ac8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:35.929075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1cc0e062-21a7-425d-96b8-a6ee7ef33ac8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:35.931817 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1cc0e062-21a7-425d-96b8-a6ee7ef33ac8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.292509 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8a67792c-2083-4cb7-9ffb-000df785eae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:36.303121 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8a67792c-2083-4cb7-9ffb-000df785eae6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1367 microversion: 2.1 time: 0.501919 Jul 18 02:37:36.304459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 156/320] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:35 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:36.309986 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-a1780dc5-1f3c-447f-9f46-71da0e42b5ff req-802bfbc4-8113-4032-be80-75a323406744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8efcc0a9-9d1f-43e8-998e-c6bd700bd24b", "tag": "8cc1584e-f2f7-4312-b8f9-de762dbe75f4"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:36.323560 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-a1780dc5-1f3c-447f-9f46-71da0e42b5ff req-802bfbc4-8113-4032-be80-75a323406744 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.324435 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-a1780dc5-1f3c-447f-9f46-71da0e42b5ff req-802bfbc4-8113-4032-be80-75a323406744 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.341393 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-a1780dc5-1f3c-447f-9f46-71da0e42b5ff req-802bfbc4-8113-4032-be80-75a323406744 service nova] Creating event network-changed:8cc1584e-f2f7-4312-b8f9-de762dbe75f4 for instance 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b on hv-cinder-85001 Jul 18 02:37:36.351030 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-a1780dc5-1f3c-447f-9f46-71da0e42b5ff req-802bfbc4-8113-4032-be80-75a323406744 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044854 Jul 18 02:37:36.352646 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 157/321] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:36.401223 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0a26a0c2-1165-4b5d-8a5e-4ebb0603b199 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:36.401701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0a26a0c2-1165-4b5d-8a5e-4ebb0603b199 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:36.421227 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a26a0c2-1165-4b5d-8a5e-4ebb0603b199 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.421865 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a26a0c2-1165-4b5d-8a5e-4ebb0603b199 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.424453 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a26a0c2-1165-4b5d-8a5e-4ebb0603b199 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.425996 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a26a0c2-1165-4b5d-8a5e-4ebb0603b199 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.479476 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1cc0e062-21a7-425d-96b8-a6ee7ef33ac8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:36.488895 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1cc0e062-21a7-425d-96b8-a6ee7ef33ac8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:36.490443 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1cc0e062-21a7-425d-96b8-a6ee7ef33ac8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:36.491679 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1cc0e062-21a7-425d-96b8-a6ee7ef33ac8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.593574 Jul 18 02:37:36.502973 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 165/322] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:35 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:36.741513 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0a26a0c2-1165-4b5d-8a5e-4ebb0603b199 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:36.753773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0a26a0c2-1165-4b5d-8a5e-4ebb0603b199 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.360441 Jul 18 02:37:36.754896 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 158/323] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:36 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:36.816442 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f2b1fc03-aa8a-4bf7-b979-7d917cae76b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:36.817106 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f2b1fc03-aa8a-4bf7-b979-7d917cae76b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:36.829303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2b1fc03-aa8a-4bf7-b979-7d917cae76b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.829782 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2b1fc03-aa8a-4bf7-b979-7d917cae76b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.830708 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2b1fc03-aa8a-4bf7-b979-7d917cae76b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.831089 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2b1fc03-aa8a-4bf7-b979-7d917cae76b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.913397 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cc0cae96-e641-4b4a-9521-7acaccdd0216 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:36.914318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cc0cae96-e641-4b4a-9521-7acaccdd0216 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:36.926238 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc0cae96-e641-4b4a-9521-7acaccdd0216 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.935019 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc0cae96-e641-4b4a-9521-7acaccdd0216 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:36.939868 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc0cae96-e641-4b4a-9521-7acaccdd0216 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:36.939868 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc0cae96-e641-4b4a-9521-7acaccdd0216 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:37.083152 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f2b1fc03-aa8a-4bf7-b979-7d917cae76b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:37.091675 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f2b1fc03-aa8a-4bf7-b979-7d917cae76b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.279814 Jul 18 02:37:37.092258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 166/324] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:36 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:37.257024 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cc0cae96-e641-4b4a-9521-7acaccdd0216 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:37.265823 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cc0cae96-e641-4b4a-9521-7acaccdd0216 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.357373 Jul 18 02:37:37.271259 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 159/325] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:36 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:37.321574 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-001b5568-1e6a-4add-8fe1-b6ce2d4124e2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:37.322630 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-001b5568-1e6a-4add-8fe1-b6ce2d4124e2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:37.330920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-001b5568-1e6a-4add-8fe1-b6ce2d4124e2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:37.331374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-001b5568-1e6a-4add-8fe1-b6ce2d4124e2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:37.332755 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-001b5568-1e6a-4add-8fe1-b6ce2d4124e2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:37.333219 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-001b5568-1e6a-4add-8fe1-b6ce2d4124e2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:37.526845 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9bdcf0e7-3995-4757-82f4-fd3853b53956 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:37.529348 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9bdcf0e7-3995-4757-82f4-fd3853b53956 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:37.548522 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bdcf0e7-3995-4757-82f4-fd3853b53956 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:37.549325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bdcf0e7-3995-4757-82f4-fd3853b53956 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:37.564360 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bdcf0e7-3995-4757-82f4-fd3853b53956 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:37.570797 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bdcf0e7-3995-4757-82f4-fd3853b53956 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:37.598902 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-001b5568-1e6a-4add-8fe1-b6ce2d4124e2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:37.615943 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-001b5568-1e6a-4add-8fe1-b6ce2d4124e2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1367 microversion: 2.1 time: 0.291128 Jul 18 02:37:37.617137 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 167/326] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:37 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:37.772082 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-27027f44-4c5b-4daf-be57-830174701a1c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:37.780038 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-27027f44-4c5b-4daf-be57-830174701a1c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:37.781815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27027f44-4c5b-4daf-be57-830174701a1c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:37.783204 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27027f44-4c5b-4daf-be57-830174701a1c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:37.784259 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27027f44-4c5b-4daf-be57-830174701a1c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:37.785315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27027f44-4c5b-4daf-be57-830174701a1c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:37.902557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9bdcf0e7-3995-4757-82f4-fd3853b53956 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:37.920763 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9bdcf0e7-3995-4757-82f4-fd3853b53956 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:37.928180 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9bdcf0e7-3995-4757-82f4-fd3853b53956 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:37.930307 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9bdcf0e7-3995-4757-82f4-fd3853b53956 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.415269 Jul 18 02:37:37.931594 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 160/327] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:37 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:38.074375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-27027f44-4c5b-4daf-be57-830174701a1c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:38.088243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-27027f44-4c5b-4daf-be57-830174701a1c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.318827 Jul 18 02:37:38.089850 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 168/328] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:37 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:38.108983 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-aa880ac7-4db3-4351-98e2-a1074181eb6e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:38.109797 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-aa880ac7-4db3-4351-98e2-a1074181eb6e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:38.118289 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aa880ac7-4db3-4351-98e2-a1074181eb6e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.119058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aa880ac7-4db3-4351-98e2-a1074181eb6e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.119998 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aa880ac7-4db3-4351-98e2-a1074181eb6e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.120448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aa880ac7-4db3-4351-98e2-a1074181eb6e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.290526 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-eec08352-11e1-415a-a9d7-9732baaa3f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:38.290967 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-eec08352-11e1-415a-a9d7-9732baaa3f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:38.309158 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:38.313243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eec08352-11e1-415a-a9d7-9732baaa3f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.317919 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eec08352-11e1-415a-a9d7-9732baaa3f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.320355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eec08352-11e1-415a-a9d7-9732baaa3f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.322285 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eec08352-11e1-415a-a9d7-9732baaa3f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.339136 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-aa880ac7-4db3-4351-98e2-a1074181eb6e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:38.350744 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-aa880ac7-4db3-4351-98e2-a1074181eb6e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.245963 Jul 18 02:37:38.355261 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 161/329] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:38 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:38.606011 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-eec08352-11e1-415a-a9d7-9732baaa3f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:38.619525 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-eec08352-11e1-415a-a9d7-9732baaa3f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.334242 Jul 18 02:37:38.620110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 169/330] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:38 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:38.637855 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2966c244-9bab-4efb-919f-eb930ab6f476 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:38.639668 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2966c244-9bab-4efb-919f-eb930ab6f476 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:38.653207 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2966c244-9bab-4efb-919f-eb930ab6f476 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.654782 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2966c244-9bab-4efb-919f-eb930ab6f476 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.655849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2966c244-9bab-4efb-919f-eb930ab6f476 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.656436 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2966c244-9bab-4efb-919f-eb930ab6f476 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.826750 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=10 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:38.884507 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2966c244-9bab-4efb-919f-eb930ab6f476 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:38.893652 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2966c244-9bab-4efb-919f-eb930ab6f476 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1367 microversion: 2.1 time: 0.260778 Jul 18 02:37:38.898535 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 162/331] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:38 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:38.951074 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0c890bfe-44f8-4dd8-ba2c-d59aa33c4b03 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:38.952009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0c890bfe-44f8-4dd8-ba2c-d59aa33c4b03 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:38.966278 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c890bfe-44f8-4dd8-ba2c-d59aa33c4b03 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.966965 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c890bfe-44f8-4dd8-ba2c-d59aa33c4b03 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:38.969077 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c890bfe-44f8-4dd8-ba2c-d59aa33c4b03 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:38.969738 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c890bfe-44f8-4dd8-ba2c-d59aa33c4b03 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.128101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-98db7a7f-7cad-48b8-996d-acd9d34be950 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:39.130568 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-98db7a7f-7cad-48b8-996d-acd9d34be950 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:39.140541 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98db7a7f-7cad-48b8-996d-acd9d34be950 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.140996 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98db7a7f-7cad-48b8-996d-acd9d34be950 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.142025 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98db7a7f-7cad-48b8-996d-acd9d34be950 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.142668 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98db7a7f-7cad-48b8-996d-acd9d34be950 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.280920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0c890bfe-44f8-4dd8-ba2c-d59aa33c4b03 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:39.291053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0c890bfe-44f8-4dd8-ba2c-d59aa33c4b03 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:39.292944 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0c890bfe-44f8-4dd8-ba2c-d59aa33c4b03 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:39.294668 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0c890bfe-44f8-4dd8-ba2c-d59aa33c4b03 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.348685 Jul 18 02:37:39.307113 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 170/332] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:38 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:39.319755 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-36902074-46a0-4f63-82b0-03446e774ec3 req-fa162063-8272-41c3-b681-aba888b6ba47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b66be0c-5ad3-410b-94f2-74110dcffc9b", "name": "network-vif-plugged", "status": "completed", "tag": "0722fc37-f557-4503-a3a5-66878f8d3c27"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:39.331625 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-36902074-46a0-4f63-82b0-03446e774ec3 req-fa162063-8272-41c3-b681-aba888b6ba47 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.332112 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-36902074-46a0-4f63-82b0-03446e774ec3 req-fa162063-8272-41c3-b681-aba888b6ba47 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.339876 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-98db7a7f-7cad-48b8-996d-acd9d34be950 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:39.343283 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:39.346561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-36902074-46a0-4f63-82b0-03446e774ec3 req-fa162063-8272-41c3-b681-aba888b6ba47 service nova] Creating event network-vif-plugged:0722fc37-f557-4503-a3a5-66878f8d3c27 for instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b on hv-cinder-85001 Jul 18 02:37:39.348325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-98db7a7f-7cad-48b8-996d-acd9d34be950 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.239305 Jul 18 02:37:39.349130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 163/333] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:39 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:39.352805 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-36902074-46a0-4f63-82b0-03446e774ec3 req-fa162063-8272-41c3-b681-aba888b6ba47 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038136 Jul 18 02:37:39.353425 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 171/334] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:37:39.371061 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fe4ea54d-2607-4094-8348-7f679e93c515 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:39.371675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fe4ea54d-2607-4094-8348-7f679e93c515 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:39.377887 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe4ea54d-2607-4094-8348-7f679e93c515 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.378382 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe4ea54d-2607-4094-8348-7f679e93c515 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.379682 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe4ea54d-2607-4094-8348-7f679e93c515 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.380211 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe4ea54d-2607-4094-8348-7f679e93c515 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.513700 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fe4ea54d-2607-4094-8348-7f679e93c515 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:39.523231 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fe4ea54d-2607-4094-8348-7f679e93c515 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.156004 Jul 18 02:37:39.523815 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 164/335] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:39 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:39.643048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0ea6953b-e6b8-4c22-9ea0-7af56a47390a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:39.644964 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0ea6953b-e6b8-4c22-9ea0-7af56a47390a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:39.654598 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ea6953b-e6b8-4c22-9ea0-7af56a47390a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.655905 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ea6953b-e6b8-4c22-9ea0-7af56a47390a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.657220 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ea6953b-e6b8-4c22-9ea0-7af56a47390a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.657753 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ea6953b-e6b8-4c22-9ea0-7af56a47390a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.917704 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-088d85ef-075f-40ec-8726-c7fbbd60df82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:39.918501 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-088d85ef-075f-40ec-8726-c7fbbd60df82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:39.944037 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-088d85ef-075f-40ec-8726-c7fbbd60df82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.944637 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-088d85ef-075f-40ec-8726-c7fbbd60df82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:39.946695 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-088d85ef-075f-40ec-8726-c7fbbd60df82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:39.950710 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-088d85ef-075f-40ec-8726-c7fbbd60df82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.054664 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0ea6953b-e6b8-4c22-9ea0-7af56a47390a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.068565 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0ea6953b-e6b8-4c22-9ea0-7af56a47390a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.433253 Jul 18 02:37:40.072569 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 172/336] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:39 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:40.259194 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-088d85ef-075f-40ec-8726-c7fbbd60df82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.268069 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-088d85ef-075f-40ec-8726-c7fbbd60df82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1367 microversion: 2.1 time: 0.355032 Jul 18 02:37:40.270736 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 165/337] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:39 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:40.321759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d9755aac-0616-4709-8039-0cc2e5e8e765 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:40.323154 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d9755aac-0616-4709-8039-0cc2e5e8e765 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:40.337590 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9755aac-0616-4709-8039-0cc2e5e8e765 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.348595 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9755aac-0616-4709-8039-0cc2e5e8e765 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.349661 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9755aac-0616-4709-8039-0cc2e5e8e765 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.350150 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9755aac-0616-4709-8039-0cc2e5e8e765 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.369672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7427c721-f680-4347-8e4e-3b8702d5714b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:40.370336 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7427c721-f680-4347-8e4e-3b8702d5714b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:40.381453 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7427c721-f680-4347-8e4e-3b8702d5714b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.382383 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7427c721-f680-4347-8e4e-3b8702d5714b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.384742 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7427c721-f680-4347-8e4e-3b8702d5714b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.387962 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7427c721-f680-4347-8e4e-3b8702d5714b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.592082 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d9755aac-0616-4709-8039-0cc2e5e8e765 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.605928 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d9755aac-0616-4709-8039-0cc2e5e8e765 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.607872 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d9755aac-0616-4709-8039-0cc2e5e8e765 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.609253 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d9755aac-0616-4709-8039-0cc2e5e8e765 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.291722 Jul 18 02:37:40.610910 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 173/338] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:40 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:40.616960 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-892112e1-c6b6-4ee4-8d93-53342b70a206 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:40.622581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-892112e1-c6b6-4ee4-8d93-53342b70a206 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:40.625058 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-892112e1-c6b6-4ee4-8d93-53342b70a206 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.625808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-892112e1-c6b6-4ee4-8d93-53342b70a206 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.626813 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-892112e1-c6b6-4ee4-8d93-53342b70a206 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:40.627409 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-892112e1-c6b6-4ee4-8d93-53342b70a206 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:40.690705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7427c721-f680-4347-8e4e-3b8702d5714b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.690705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7427c721-f680-4347-8e4e-3b8702d5714b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.304315 Jul 18 02:37:40.690705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 166/339] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:40 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:40.929663 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-892112e1-c6b6-4ee4-8d93-53342b70a206 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:40.937426 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-892112e1-c6b6-4ee4-8d93-53342b70a206 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.325232 Jul 18 02:37:40.941683 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 174/340] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:40 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:41.090878 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a859030d-1e8d-41c7-96f5-6583c37cb782 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:41.091814 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a859030d-1e8d-41c7-96f5-6583c37cb782 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:41.099576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a859030d-1e8d-41c7-96f5-6583c37cb782 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.104126 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a859030d-1e8d-41c7-96f5-6583c37cb782 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.104126 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a859030d-1e8d-41c7-96f5-6583c37cb782 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.104126 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a859030d-1e8d-41c7-96f5-6583c37cb782 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.282970 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a859030d-1e8d-41c7-96f5-6583c37cb782 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:41.285637 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-41b0d06e-2299-4e14-b5b8-1d3c876b1176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:41.286667 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-41b0d06e-2299-4e14-b5b8-1d3c876b1176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:41.293488 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41b0d06e-2299-4e14-b5b8-1d3c876b1176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.293940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41b0d06e-2299-4e14-b5b8-1d3c876b1176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.294752 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41b0d06e-2299-4e14-b5b8-1d3c876b1176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.295151 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a859030d-1e8d-41c7-96f5-6583c37cb782 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.208594 Jul 18 02:37:41.295561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41b0d06e-2299-4e14-b5b8-1d3c876b1176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.305923 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 167/341] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:41 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:41.562170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-41b0d06e-2299-4e14-b5b8-1d3c876b1176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:41.580193 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-41b0d06e-2299-4e14-b5b8-1d3c876b1176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1367 microversion: 2.1 time: 0.299103 Jul 18 02:37:41.589630 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 175/342] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:41 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:41.631324 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-dd2576cf-5f8a-461e-b22b-f345b25b0063 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:41.632705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-dd2576cf-5f8a-461e-b22b-f345b25b0063 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:41.657860 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd2576cf-5f8a-461e-b22b-f345b25b0063 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.663416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd2576cf-5f8a-461e-b22b-f345b25b0063 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.664581 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd2576cf-5f8a-461e-b22b-f345b25b0063 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.665038 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd2576cf-5f8a-461e-b22b-f345b25b0063 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.685570 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-dfecef8a-c42e-4b53-b4ab-197768353b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:41.686560 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-dfecef8a-c42e-4b53-b4ab-197768353b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:41.695035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dfecef8a-c42e-4b53-b4ab-197768353b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.695805 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dfecef8a-c42e-4b53-b4ab-197768353b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.697438 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dfecef8a-c42e-4b53-b4ab-197768353b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.698118 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dfecef8a-c42e-4b53-b4ab-197768353b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.896924 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-dfecef8a-c42e-4b53-b4ab-197768353b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:41.907935 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-dfecef8a-c42e-4b53-b4ab-197768353b41 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.227047 Jul 18 02:37:41.909558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 176/343] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:41 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:41.958854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-eecd4299-ad1d-4a53-a4e7-fa107b80a8d8 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:41.959550 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-eecd4299-ad1d-4a53-a4e7-fa107b80a8d8 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:41.972332 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eecd4299-ad1d-4a53-a4e7-fa107b80a8d8 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.976155 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eecd4299-ad1d-4a53-a4e7-fa107b80a8d8 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:41.976155 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eecd4299-ad1d-4a53-a4e7-fa107b80a8d8 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:41.976155 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eecd4299-ad1d-4a53-a4e7-fa107b80a8d8 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.025816 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dd2576cf-5f8a-461e-b22b-f345b25b0063 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.043409 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dd2576cf-5f8a-461e-b22b-f345b25b0063 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.053982 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dd2576cf-5f8a-461e-b22b-f345b25b0063 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.060862 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-dd2576cf-5f8a-461e-b22b-f345b25b0063 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.433463 Jul 18 02:37:42.061517 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 168/344] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:41 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:42.247760 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-eecd4299-ad1d-4a53-a4e7-fa107b80a8d8 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.257666 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-eecd4299-ad1d-4a53-a4e7-fa107b80a8d8 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.303192 Jul 18 02:37:42.262153 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 177/345] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:41 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:42.313473 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1d78eed5-af7c-4ff6-9549-23c388874051 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:42.315067 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1d78eed5-af7c-4ff6-9549-23c388874051 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:42.330720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d78eed5-af7c-4ff6-9549-23c388874051 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.338278 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d78eed5-af7c-4ff6-9549-23c388874051 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.339284 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d78eed5-af7c-4ff6-9549-23c388874051 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.339839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d78eed5-af7c-4ff6-9549-23c388874051 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.596651 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f7efa995-fa89-4cc4-a520-451da1123c19 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:42.597260 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f7efa995-fa89-4cc4-a520-451da1123c19 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:42.612867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f7efa995-fa89-4cc4-a520-451da1123c19 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.614309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f7efa995-fa89-4cc4-a520-451da1123c19 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.615297 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f7efa995-fa89-4cc4-a520-451da1123c19 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.615900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f7efa995-fa89-4cc4-a520-451da1123c19 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.700149 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1d78eed5-af7c-4ff6-9549-23c388874051 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.711099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1d78eed5-af7c-4ff6-9549-23c388874051 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.401365 Jul 18 02:37:42.723189 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 169/346] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:42 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:42.875607 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f7efa995-fa89-4cc4-a520-451da1123c19 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:42.884153 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f7efa995-fa89-4cc4-a520-451da1123c19 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1558 microversion: 2.1 time: 0.291249 Jul 18 02:37:42.890832 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 178/347] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:42 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1558 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:42.906756 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b9f0cce3-bd09-4be6-bf4f-d078ac35bcc9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:42.907179 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b9f0cce3-bd09-4be6-bf4f-d078ac35bcc9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:42.916745 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b9f0cce3-bd09-4be6-bf4f-d078ac35bcc9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.917210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b9f0cce3-bd09-4be6-bf4f-d078ac35bcc9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.918973 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b9f0cce3-bd09-4be6-bf4f-d078ac35bcc9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.919088 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b9f0cce3-bd09-4be6-bf4f-d078ac35bcc9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.931053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-24480179-ede8-4426-b773-66a6535d71fa tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:42.931894 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-24480179-ede8-4426-b773-66a6535d71fa tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:42.940085 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24480179-ede8-4426-b773-66a6535d71fa tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.940838 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24480179-ede8-4426-b773-66a6535d71fa tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:42.942377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24480179-ede8-4426-b773-66a6535d71fa tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:42.943275 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24480179-ede8-4426-b773-66a6535d71fa tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.117565 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-24480179-ede8-4426-b773-66a6535d71fa tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:43.127268 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-24480179-ede8-4426-b773-66a6535d71fa tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.205011 Jul 18 02:37:43.133383 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 179/348] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:42 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:43.134028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-991ddd3c-8d99-40bb-971b-53f039987515 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:43.135006 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-991ddd3c-8d99-40bb-971b-53f039987515 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:43.142131 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-991ddd3c-8d99-40bb-971b-53f039987515 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.142981 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-991ddd3c-8d99-40bb-971b-53f039987515 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.144001 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-991ddd3c-8d99-40bb-971b-53f039987515 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.144880 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-991ddd3c-8d99-40bb-971b-53f039987515 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.259559 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b9f0cce3-bd09-4be6-bf4f-d078ac35bcc9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.356733 Jul 18 02:37:43.260666 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 170/349] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 18 02:37:42 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b/os-interface => generated 285 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:37:43.276037 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d8b2c438-5e23-4236-97aa-1735c0a60282 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:43.276647 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d8b2c438-5e23-4236-97aa-1735c0a60282 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:43.289399 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8b2c438-5e23-4236-97aa-1735c0a60282 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.289847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8b2c438-5e23-4236-97aa-1735c0a60282 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.290673 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8b2c438-5e23-4236-97aa-1735c0a60282 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.291106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8b2c438-5e23-4236-97aa-1735c0a60282 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.738502 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d8b2c438-5e23-4236-97aa-1735c0a60282 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:43.746608 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d8b2c438-5e23-4236-97aa-1735c0a60282 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.474768 Jul 18 02:37:43.755550 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 171/350] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:43 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:43.778583 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6317f589-784c-4007-aa58-415efee8d694 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:43.782062 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6317f589-784c-4007-aa58-415efee8d694 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:43.814962 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6317f589-784c-4007-aa58-415efee8d694 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.840413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6317f589-784c-4007-aa58-415efee8d694 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:43.840413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6317f589-784c-4007-aa58-415efee8d694 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:43.840413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6317f589-784c-4007-aa58-415efee8d694 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.109710 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6317f589-784c-4007-aa58-415efee8d694 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.122777 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6317f589-784c-4007-aa58-415efee8d694 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.365896 Jul 18 02:37:44.124076 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 172/351] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:43 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:44.129334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-cbc86b50-10bf-4236-95d0-30a79ac101bf req-206d0fed-941d-41c6-b50d-263f24112738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8efcc0a9-9d1f-43e8-998e-c6bd700bd24b", "name": "network-vif-plugged", "status": "completed", "tag": "8cc1584e-f2f7-4312-b8f9-de762dbe75f4"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:44.140871 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-cbc86b50-10bf-4236-95d0-30a79ac101bf req-206d0fed-941d-41c6-b50d-263f24112738 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.142312 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-cbc86b50-10bf-4236-95d0-30a79ac101bf req-206d0fed-941d-41c6-b50d-263f24112738 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.170480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-cbc86b50-10bf-4236-95d0-30a79ac101bf req-206d0fed-941d-41c6-b50d-263f24112738 service nova] Creating event network-vif-plugged:8cc1584e-f2f7-4312-b8f9-de762dbe75f4 for instance 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b on hv-cinder-85001 Jul 18 02:37:44.184200 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-cbc86b50-10bf-4236-95d0-30a79ac101bf req-206d0fed-941d-41c6-b50d-263f24112738 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058547 Jul 18 02:37:44.185317 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 173/352] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:44.198775 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-69cd6b23-d71f-4f1c-9ceb-e75bb7901c89 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:44.201443 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-69cd6b23-d71f-4f1c-9ceb-e75bb7901c89 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:44.222585 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69cd6b23-d71f-4f1c-9ceb-e75bb7901c89 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.223724 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69cd6b23-d71f-4f1c-9ceb-e75bb7901c89 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.224780 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69cd6b23-d71f-4f1c-9ceb-e75bb7901c89 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.225813 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69cd6b23-d71f-4f1c-9ceb-e75bb7901c89 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.400950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-991ddd3c-8d99-40bb-971b-53f039987515 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.439163 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-991ddd3c-8d99-40bb-971b-53f039987515 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.440852 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-991ddd3c-8d99-40bb-971b-53f039987515 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.444935 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-991ddd3c-8d99-40bb-971b-53f039987515 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 1.315488 Jul 18 02:37:44.450883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 180/353] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:43 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:44.690865 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-69cd6b23-d71f-4f1c-9ceb-e75bb7901c89 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:44.706519 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-69cd6b23-d71f-4f1c-9ceb-e75bb7901c89 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.511157 Jul 18 02:37:44.708654 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 174/354] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:44 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:44.770509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-92d1e71c-8d80-428f-8c05-7b64f932b598 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:44.770509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-92d1e71c-8d80-428f-8c05-7b64f932b598 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:44.790846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-92d1e71c-8d80-428f-8c05-7b64f932b598 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.791303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-92d1e71c-8d80-428f-8c05-7b64f932b598 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.792101 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-92d1e71c-8d80-428f-8c05-7b64f932b598 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:44.798271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-92d1e71c-8d80-428f-8c05-7b64f932b598 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:44.852858 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:45.143934 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-41856410-ee5d-4df7-8c32-0d285235a3c7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:45.146214 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-41856410-ee5d-4df7-8c32-0d285235a3c7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:45.158169 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-41856410-ee5d-4df7-8c32-0d285235a3c7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.162195 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-41856410-ee5d-4df7-8c32-0d285235a3c7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.173663 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-41856410-ee5d-4df7-8c32-0d285235a3c7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.177359 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-41856410-ee5d-4df7-8c32-0d285235a3c7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.336016 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-92d1e71c-8d80-428f-8c05-7b64f932b598 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.344153 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-92d1e71c-8d80-428f-8c05-7b64f932b598 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.579210 Jul 18 02:37:45.344736 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 181/355] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:44 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:45.469420 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-70e8c2b7-5ba2-4169-9678-35da0d4d3a10 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:45.470118 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-70e8c2b7-5ba2-4169-9678-35da0d4d3a10 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:45.477742 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-70e8c2b7-5ba2-4169-9678-35da0d4d3a10 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.478422 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-70e8c2b7-5ba2-4169-9678-35da0d4d3a10 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.479391 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-70e8c2b7-5ba2-4169-9678-35da0d4d3a10 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.479989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-70e8c2b7-5ba2-4169-9678-35da0d4d3a10 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.652778 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-41856410-ee5d-4df7-8c32-0d285235a3c7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.666893 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-41856410-ee5d-4df7-8c32-0d285235a3c7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.529929 Jul 18 02:37:45.678854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 175/356] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:45 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:45.724955 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2bdfe56e-56fe-4cb3-b557-02abd1af014c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:45.725552 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2bdfe56e-56fe-4cb3-b557-02abd1af014c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:45.742809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bdfe56e-56fe-4cb3-b557-02abd1af014c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.742809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bdfe56e-56fe-4cb3-b557-02abd1af014c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.742809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bdfe56e-56fe-4cb3-b557-02abd1af014c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:45.742809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2bdfe56e-56fe-4cb3-b557-02abd1af014c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:45.789289 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-70e8c2b7-5ba2-4169-9678-35da0d4d3a10 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.802143 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-70e8c2b7-5ba2-4169-9678-35da0d4d3a10 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.805106 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-70e8c2b7-5ba2-4169-9678-35da0d4d3a10 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:45.808220 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-70e8c2b7-5ba2-4169-9678-35da0d4d3a10 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.342677 Jul 18 02:37:45.821324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 182/357] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:45 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:46.017168 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2bdfe56e-56fe-4cb3-b557-02abd1af014c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:46.027209 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2bdfe56e-56fe-4cb3-b557-02abd1af014c tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.307386 Jul 18 02:37:46.027820 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 176/358] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:45 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:46.232182 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-91d0eed0-fc23-44fd-ab9c-a4b00c19267a req-5c0f1c37-9462-4eab-9967-8c5255c257a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b66be0c-5ad3-410b-94f2-74110dcffc9b", "tag": "0722fc37-f557-4503-a3a5-66878f8d3c27"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:46.241621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-91d0eed0-fc23-44fd-ab9c-a4b00c19267a req-5c0f1c37-9462-4eab-9967-8c5255c257a4 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.242066 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-91d0eed0-fc23-44fd-ab9c-a4b00c19267a req-5c0f1c37-9462-4eab-9967-8c5255c257a4 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.255878 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-91d0eed0-fc23-44fd-ab9c-a4b00c19267a req-5c0f1c37-9462-4eab-9967-8c5255c257a4 service nova] Creating event network-changed:0722fc37-f557-4503-a3a5-66878f8d3c27 for instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b on hv-cinder-85001 Jul 18 02:37:46.263386 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-91d0eed0-fc23-44fd-ab9c-a4b00c19267a req-5c0f1c37-9462-4eab-9967-8c5255c257a4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034721 Jul 18 02:37:46.264652 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 183/359] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:46.364790 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-601505c0-3200-4bec-b076-d5a1849de7f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:46.369645 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-601505c0-3200-4bec-b076-d5a1849de7f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:46.426004 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-601505c0-3200-4bec-b076-d5a1849de7f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.427412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-601505c0-3200-4bec-b076-d5a1849de7f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.428421 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-601505c0-3200-4bec-b076-d5a1849de7f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.429029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-601505c0-3200-4bec-b076-d5a1849de7f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.650836 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-601505c0-3200-4bec-b076-d5a1849de7f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:46.665241 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-601505c0-3200-4bec-b076-d5a1849de7f9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.305917 Jul 18 02:37:46.665818 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 177/360] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:46 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:46.685856 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cd414a0c-1c4e-44af-93ca-7de7227b5c5b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:46.686635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-cd414a0c-1c4e-44af-93ca-7de7227b5c5b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:46.693970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd414a0c-1c4e-44af-93ca-7de7227b5c5b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.694458 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd414a0c-1c4e-44af-93ca-7de7227b5c5b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.695259 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd414a0c-1c4e-44af-93ca-7de7227b5c5b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:46.695877 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd414a0c-1c4e-44af-93ca-7de7227b5c5b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:46.828894 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fce26175-5936-43c4-91b8-eb379aa0aff0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:47.030480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fce26175-5936-43c4-91b8-eb379aa0aff0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:47.030480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fce26175-5936-43c4-91b8-eb379aa0aff0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.030480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fce26175-5936-43c4-91b8-eb379aa0aff0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.030480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fce26175-5936-43c4-91b8-eb379aa0aff0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.030970 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fce26175-5936-43c4-91b8-eb379aa0aff0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.031150 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-cd414a0c-1c4e-44af-93ca-7de7227b5c5b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.031150 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-cd414a0c-1c4e-44af-93ca-7de7227b5c5b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.231708 Jul 18 02:37:47.031150 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 184/361] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:46 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:47.031953 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fce26175-5936-43c4-91b8-eb379aa0aff0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.031953 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fce26175-5936-43c4-91b8-eb379aa0aff0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.032390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fce26175-5936-43c4-91b8-eb379aa0aff0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.032390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fce26175-5936-43c4-91b8-eb379aa0aff0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.200964 Jul 18 02:37:47.032390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 178/362] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:46 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:37:47.046107 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4003d751-04b1-4b7d-85c5-3b047fb5347f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:47.047042 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4003d751-04b1-4b7d-85c5-3b047fb5347f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:47.055092 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4003d751-04b1-4b7d-85c5-3b047fb5347f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.055632 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4003d751-04b1-4b7d-85c5-3b047fb5347f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.056487 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4003d751-04b1-4b7d-85c5-3b047fb5347f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.056999 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4003d751-04b1-4b7d-85c5-3b047fb5347f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.200091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4003d751-04b1-4b7d-85c5-3b047fb5347f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.207934 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4003d751-04b1-4b7d-85c5-3b047fb5347f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1314 microversion: 2.1 time: 0.165690 Jul 18 02:37:47.208524 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 185/363] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:47 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:47.683333 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-aae374ca-f64e-4b17-b1ae-9ed29d4a4edd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:47.688335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-aae374ca-f64e-4b17-b1ae-9ed29d4a4edd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:47.696268 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aae374ca-f64e-4b17-b1ae-9ed29d4a4edd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.696852 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aae374ca-f64e-4b17-b1ae-9ed29d4a4edd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.697722 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aae374ca-f64e-4b17-b1ae-9ed29d4a4edd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.698416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aae374ca-f64e-4b17-b1ae-9ed29d4a4edd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.890025 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-aae374ca-f64e-4b17-b1ae-9ed29d4a4edd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:47.913624 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-aae374ca-f64e-4b17-b1ae-9ed29d4a4edd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1501 microversion: 2.1 time: 0.233894 Jul 18 02:37:47.925270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 179/364] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:47 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1501 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:47.937515 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-17dd8ba6-4816-4c3a-98a2-147d25611846 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fddce2a2-3a98-4042-a33e-9616ab9b68e3"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:47.937515 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-17dd8ba6-4816-4c3a-98a2-147d25611846 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:47.944992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-17dd8ba6-4816-4c3a-98a2-147d25611846 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.945644 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-17dd8ba6-4816-4c3a-98a2-147d25611846 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.947207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-17dd8ba6-4816-4c3a-98a2-147d25611846 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:47.948047 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-17dd8ba6-4816-4c3a-98a2-147d25611846 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:47.983542 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-17dd8ba6-4816-4c3a-98a2-147d25611846 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] HTTP exception thrown: Cannot 'attach_volume' instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 while it is in vm_state rescued Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-17dd8ba6-4816-4c3a-98a2-147d25611846 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Request method failure captured: Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: POST /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8/os-volume_attachments HTTP/1.1 Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 74 Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1McuPtx3mXnBtnAQz6hcyUDMQQKVKo-T7dvPGtmZuTuHw7GzvsTn0I34zu4yEdIofz-yDNRRgXDEBOkIkJBrQ94epik1LKFvkwOHcowjlukXqP9m0auyRN8lNxgEcAPqwnRsqanPw5IYVJ7_ivL4Sbf9V6H62dfIQ2mbExpaWFvVh-Y Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 9ec4c1c1687944b98c1c5cefe05df095 Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:37:47.987586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9ec4c1c1687944b98c1c5cefe05df095", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 9ec4c1c1687944b98c1c5cefe05df095 Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-ServerRescueNegativeTestJSON-988773994-project Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: d281c92e20d04004a679a8ec65f9e6d5 Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-ServerRescueNegativeTestJSON-988773994-project Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {"volumeAttachment": {"volumeId": "fddce2a2-3a98-4042-a33e-9616ab9b68e3"}} Jul 18 02:37:47.989315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Cannot 'attach_volume' instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 while it is in vm_state rescued Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'server_id': '8f7f8048-6316-49a6-89a0-2b5113d7d9f8', 'body': {'volumeAttachment': {'volumeId': 'fddce2a2-3a98-4042-a33e-9616ab9b68e3'}}} Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:47.990324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 while it is in vm_state rescued Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:47.991799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:47.993169 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:37:47.993169 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:37:47.993169 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 while it is in vm_state rescued Jul 18 02:37:47.993169 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:37:47.994577 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-17dd8ba6-4816-4c3a-98a2-147d25611846 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Returning 409 to user: Cannot 'attach_volume' instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 while it is in vm_state rescued {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:47.995625 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-17dd8ba6-4816-4c3a-98a2-147d25611846 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.068667 Jul 18 02:37:48.001277 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 186/365] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:37:47 2022] POST /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8/os-volume_attachments => generated 152 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 02:37:48.008495 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0fef407a-fd08-4183-9b9d-5dd1939b5719 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:48.010003 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0fef407a-fd08-4183-9b9d-5dd1939b5719 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:48.025833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0fef407a-fd08-4183-9b9d-5dd1939b5719 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.036972 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0fef407a-fd08-4183-9b9d-5dd1939b5719 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.038235 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0fef407a-fd08-4183-9b9d-5dd1939b5719 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.039655 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0fef407a-fd08-4183-9b9d-5dd1939b5719 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.055349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-00d6b74c-fdd1-4456-9a42-f011e66b9df5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:48.055973 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-00d6b74c-fdd1-4456-9a42-f011e66b9df5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:48.064091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00d6b74c-fdd1-4456-9a42-f011e66b9df5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.064863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00d6b74c-fdd1-4456-9a42-f011e66b9df5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.065831 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00d6b74c-fdd1-4456-9a42-f011e66b9df5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.066460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00d6b74c-fdd1-4456-9a42-f011e66b9df5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.129573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:48.316204 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-00d6b74c-fdd1-4456-9a42-f011e66b9df5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:48.330783 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-00d6b74c-fdd1-4456-9a42-f011e66b9df5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.281526 Jul 18 02:37:48.332527 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 187/366] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:48 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:48.342028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ea0075f9-e238-493c-b54f-553deec26b5e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:48.343593 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ea0075f9-e238-493c-b54f-553deec26b5e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:48.356287 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea0075f9-e238-493c-b54f-553deec26b5e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.356778 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea0075f9-e238-493c-b54f-553deec26b5e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.357762 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea0075f9-e238-493c-b54f-553deec26b5e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.358387 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea0075f9-e238-493c-b54f-553deec26b5e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.398578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0fef407a-fd08-4183-9b9d-5dd1939b5719 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8/action" status: 202 len: 0 microversion: 2.1 time: 0.395796 Jul 18 02:37:48.399894 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 180/367] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:37:48 2022] POST /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:37:48.405229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f5b7a524-3074-48bd-92ab-0a67b1639db2 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:48.411459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f5b7a524-3074-48bd-92ab-0a67b1639db2 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:48.421204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f5b7a524-3074-48bd-92ab-0a67b1639db2 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.421477 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f5b7a524-3074-48bd-92ab-0a67b1639db2 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.422514 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f5b7a524-3074-48bd-92ab-0a67b1639db2 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.423145 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f5b7a524-3074-48bd-92ab-0a67b1639db2 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.619264 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f5b7a524-3074-48bd-92ab-0a67b1639db2 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:48.642411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f5b7a524-3074-48bd-92ab-0a67b1639db2 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1499 microversion: 2.1 time: 0.225880 Jul 18 02:37:48.642411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 181/368] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:48 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1499 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:48.643551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4d18cb27-d245-4529-b44b-b79f41b5999d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:48.643551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4d18cb27-d245-4529-b44b-b79f41b5999d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:48.655535 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d18cb27-d245-4529-b44b-b79f41b5999d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.663748 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d18cb27-d245-4529-b44b-b79f41b5999d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.664784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d18cb27-d245-4529-b44b-b79f41b5999d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:48.665330 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d18cb27-d245-4529-b44b-b79f41b5999d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:48.907620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4d18cb27-d245-4529-b44b-b79f41b5999d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:48.916641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4d18cb27-d245-4529-b44b-b79f41b5999d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.288158 Jul 18 02:37:48.917221 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 182/369] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:48 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1509 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:49.077740 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ea0075f9-e238-493c-b54f-553deec26b5e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:49.101974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ea0075f9-e238-493c-b54f-553deec26b5e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:49.104366 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ea0075f9-e238-493c-b54f-553deec26b5e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:49.108047 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ea0075f9-e238-493c-b54f-553deec26b5e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.773722 Jul 18 02:37:49.109028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 188/370] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:48 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:49.352453 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b62b5d53-5ee8-4482-8b78-4d6e29d46ee2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:49.353581 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b62b5d53-5ee8-4482-8b78-4d6e29d46ee2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:49.378337 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b62b5d53-5ee8-4482-8b78-4d6e29d46ee2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:49.382518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b62b5d53-5ee8-4482-8b78-4d6e29d46ee2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:49.382518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b62b5d53-5ee8-4482-8b78-4d6e29d46ee2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:49.382518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b62b5d53-5ee8-4482-8b78-4d6e29d46ee2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:49.677029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b62b5d53-5ee8-4482-8b78-4d6e29d46ee2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:49.687881 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b62b5d53-5ee8-4482-8b78-4d6e29d46ee2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.342065 Jul 18 02:37:49.691334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 183/371] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:49 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:49.935762 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-528bb29b-2c62-4620-a37d-4878ba0dcc6b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:49.936829 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-528bb29b-2c62-4620-a37d-4878ba0dcc6b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:49.952149 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-528bb29b-2c62-4620-a37d-4878ba0dcc6b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:49.959192 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-528bb29b-2c62-4620-a37d-4878ba0dcc6b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:49.960164 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-528bb29b-2c62-4620-a37d-4878ba0dcc6b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:49.960629 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-528bb29b-2c62-4620-a37d-4878ba0dcc6b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.049651 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-74605c57-596f-4d30-83d3-b9fced7e6a17 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:50.050806 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-74605c57-596f-4d30-83d3-b9fced7e6a17 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:50.077723 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-74605c57-596f-4d30-83d3-b9fced7e6a17 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:50.086459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-74605c57-596f-4d30-83d3-b9fced7e6a17 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.087687 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-74605c57-596f-4d30-83d3-b9fced7e6a17 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:50.088466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-74605c57-596f-4d30-83d3-b9fced7e6a17 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.138430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-74605c57-596f-4d30-83d3-b9fced7e6a17 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Going to try to terminate instance {{(pid=124890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:37:50.473129 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:50.562198 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-74605c57-596f-4d30-83d3-b9fced7e6a17 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 204 len: 0 microversion: 2.1 time: 0.516901 Jul 18 02:37:50.563087 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 184/372] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:37:50 2022] DELETE /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:37:50.573022 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ecfccb4a-1dda-4da1-866d-f27a04f2decf tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:50.576391 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-ecfccb4a-1dda-4da1-866d-f27a04f2decf tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:50.604614 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ecfccb4a-1dda-4da1-866d-f27a04f2decf tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:50.605431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ecfccb4a-1dda-4da1-866d-f27a04f2decf tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.606531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ecfccb4a-1dda-4da1-866d-f27a04f2decf tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:50.607213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ecfccb4a-1dda-4da1-866d-f27a04f2decf tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.752064 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-528bb29b-2c62-4620-a37d-4878ba0dcc6b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:50.764740 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-528bb29b-2c62-4620-a37d-4878ba0dcc6b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.833098 Jul 18 02:37:50.780301 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 189/373] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:49 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1509 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:50.792740 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-46e33b7f-8b16-4ae5-8b01-87c54576909f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:50.793940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-46e33b7f-8b16-4ae5-8b01-87c54576909f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:50.805624 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46e33b7f-8b16-4ae5-8b01-87c54576909f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:50.808694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46e33b7f-8b16-4ae5-8b01-87c54576909f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.810966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46e33b7f-8b16-4ae5-8b01-87c54576909f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:50.812064 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46e33b7f-8b16-4ae5-8b01-87c54576909f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.876956 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ecfccb4a-1dda-4da1-866d-f27a04f2decf tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:50.892336 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ecfccb4a-1dda-4da1-866d-f27a04f2decf tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:50.906245 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ecfccb4a-1dda-4da1-866d-f27a04f2decf tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:50.908005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ecfccb4a-1dda-4da1-866d-f27a04f2decf tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.342743 Jul 18 02:37:50.908946 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 185/374] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:50 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:50.915958 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4e6104c9-c0a8-44dd-b10d-6bf7284995c5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:50.916843 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4e6104c9-c0a8-44dd-b10d-6bf7284995c5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:50.924457 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e6104c9-c0a8-44dd-b10d-6bf7284995c5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:50.924457 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e6104c9-c0a8-44dd-b10d-6bf7284995c5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:50.925259 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e6104c9-c0a8-44dd-b10d-6bf7284995c5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:50.925896 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e6104c9-c0a8-44dd-b10d-6bf7284995c5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:51.105567 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-46e33b7f-8b16-4ae5-8b01-87c54576909f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:51.121116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-46e33b7f-8b16-4ae5-8b01-87c54576909f tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1505 microversion: 2.1 time: 0.334114 Jul 18 02:37:51.122937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 190/375] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:50 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:51.182343 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4e6104c9-c0a8-44dd-b10d-6bf7284995c5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:51.219324 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4e6104c9-c0a8-44dd-b10d-6bf7284995c5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.306881 Jul 18 02:37:51.221866 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 186/376] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:50 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:51.788679 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-30d00a7d-5330-4cd5-84aa-9d85614ffee5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:51.790170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-30d00a7d-5330-4cd5-84aa-9d85614ffee5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:51.799535 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30d00a7d-5330-4cd5-84aa-9d85614ffee5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:51.800335 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30d00a7d-5330-4cd5-84aa-9d85614ffee5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:51.801406 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30d00a7d-5330-4cd5-84aa-9d85614ffee5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:51.803284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30d00a7d-5330-4cd5-84aa-9d85614ffee5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:51.928790 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-53854a15-7afb-4134-8f85-c7d3947e90b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:51.929434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-53854a15-7afb-4134-8f85-c7d3947e90b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:51.948349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53854a15-7afb-4134-8f85-c7d3947e90b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:51.948889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53854a15-7afb-4134-8f85-c7d3947e90b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:51.950298 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53854a15-7afb-4134-8f85-c7d3947e90b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:51.951026 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-53854a15-7afb-4134-8f85-c7d3947e90b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:52.192282 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-30d00a7d-5330-4cd5-84aa-9d85614ffee5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:52.201963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-30d00a7d-5330-4cd5-84aa-9d85614ffee5 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.417779 Jul 18 02:37:52.203023 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 191/377] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:51 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:52.209474 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-957aa617-83e7-4983-8506-8264a7f5d1eb tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:52.210349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-957aa617-83e7-4983-8506-8264a7f5d1eb tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:52.216734 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-957aa617-83e7-4983-8506-8264a7f5d1eb tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:52.217185 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-957aa617-83e7-4983-8506-8264a7f5d1eb tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:52.218080 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-957aa617-83e7-4983-8506-8264a7f5d1eb tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:52.218554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-957aa617-83e7-4983-8506-8264a7f5d1eb tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:52.222844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-53854a15-7afb-4134-8f85-c7d3947e90b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:52.242322 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-53854a15-7afb-4134-8f85-c7d3947e90b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:52.244679 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-53854a15-7afb-4134-8f85-c7d3947e90b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:52.247719 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-53854a15-7afb-4134-8f85-c7d3947e90b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.322565 Jul 18 02:37:52.248873 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 187/378] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:51 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:52.391559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-957aa617-83e7-4983-8506-8264a7f5d1eb tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:52.403034 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-957aa617-83e7-4983-8506-8264a7f5d1eb tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1505 microversion: 2.1 time: 0.198011 Jul 18 02:37:52.403932 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 192/379] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:52 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:52.409392 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f9868365-4c53-42c1-a59e-c2f0082f7b4a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:52.410079 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f9868365-4c53-42c1-a59e-c2f0082f7b4a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:52.419577 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f9868365-4c53-42c1-a59e-c2f0082f7b4a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:52.420121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f9868365-4c53-42c1-a59e-c2f0082f7b4a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:52.421176 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f9868365-4c53-42c1-a59e-c2f0082f7b4a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:52.421640 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f9868365-4c53-42c1-a59e-c2f0082f7b4a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:52.455962 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7dbdaa7e-01f7-4f1d-9bab-2e4740200dfa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Action: 'create', calling method: .version_select at 0x7f28ee02e310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-530523020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUxJvYNfllo3cHoq7I7TUJe7WUx1J6UjaNKPEZYbNZM11mL9B10sQ/60XJtU09ZU3a4YjpBuKFBvnij08looir9uSjjQSwhGFe0hf2dUCpRpdotIeWicUKAaUekAV6pQQ=="}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:52.476063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-7dbdaa7e-01f7-4f1d-9bab-2e4740200dfa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Getting quotas for project 807f88779cf842f3bbe09615d470f44c. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:52.480959 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-7dbdaa7e-01f7-4f1d-9bab-2e4740200dfa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Getting quotas for user 41a452eca3af46b09f56a80fa8652247 and project 807f88779cf842f3bbe09615d470f44c. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:52.609350 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f9868365-4c53-42c1-a59e-c2f0082f7b4a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:52.618470 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f9868365-4c53-42c1-a59e-c2f0082f7b4a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.212751 Jul 18 02:37:52.619040 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 193/380] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:52 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:52.670889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7dbdaa7e-01f7-4f1d-9bab-2e4740200dfa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.420719 Jul 18 02:37:52.671500 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 188/381] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 18 02:37:52 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:53.223282 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6b5cf902-d721-4f56-828b-b98128cbeaf1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:53.224468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6b5cf902-d721-4f56-828b-b98128cbeaf1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:53.234172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6b5cf902-d721-4f56-828b-b98128cbeaf1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.240735 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6b5cf902-d721-4f56-828b-b98128cbeaf1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.242549 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6b5cf902-d721-4f56-828b-b98128cbeaf1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.243017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6b5cf902-d721-4f56-828b-b98128cbeaf1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.273655 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4c04e7a3-2247-4a39-b90c-7906cb2f00e9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:53.274891 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4c04e7a3-2247-4a39-b90c-7906cb2f00e9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:53.295689 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4c04e7a3-2247-4a39-b90c-7906cb2f00e9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.297359 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4c04e7a3-2247-4a39-b90c-7906cb2f00e9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.299905 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4c04e7a3-2247-4a39-b90c-7906cb2f00e9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.301445 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4c04e7a3-2247-4a39-b90c-7906cb2f00e9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.535322 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4c04e7a3-2247-4a39-b90c-7906cb2f00e9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:53.546970 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4c04e7a3-2247-4a39-b90c-7906cb2f00e9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:53.549677 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4c04e7a3-2247-4a39-b90c-7906cb2f00e9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:53.551327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4c04e7a3-2247-4a39-b90c-7906cb2f00e9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.284156 Jul 18 02:37:53.553076 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 189/382] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:53 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:53.558551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ff4d94d7-4dc7-40ac-9fa7-f4f968e3fee8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:53.561172 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-ff4d94d7-4dc7-40ac-9fa7-f4f968e3fee8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:53.577085 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ff4d94d7-4dc7-40ac-9fa7-f4f968e3fee8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.577534 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ff4d94d7-4dc7-40ac-9fa7-f4f968e3fee8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.583777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6b5cf902-d721-4f56-828b-b98128cbeaf1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:53.595704 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ff4d94d7-4dc7-40ac-9fa7-f4f968e3fee8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.597696 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6b5cf902-d721-4f56-828b-b98128cbeaf1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1509 microversion: 2.1 time: 0.380993 Jul 18 02:37:53.598959 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ff4d94d7-4dc7-40ac-9fa7-f4f968e3fee8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.600757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 194/383] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:53 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:53.636844 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ef132d60-54e0-4b64-967d-f175c90a1c2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:53.637946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ef132d60-54e0-4b64-967d-f175c90a1c2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:53.647384 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ef132d60-54e0-4b64-967d-f175c90a1c2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.650365 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ef132d60-54e0-4b64-967d-f175c90a1c2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.651348 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ef132d60-54e0-4b64-967d-f175c90a1c2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:53.652772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ef132d60-54e0-4b64-967d-f175c90a1c2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:53.841681 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ff4d94d7-4dc7-40ac-9fa7-f4f968e3fee8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:53.874347 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ff4d94d7-4dc7-40ac-9fa7-f4f968e3fee8 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1505 microversion: 2.1 time: 0.319568 Jul 18 02:37:53.878286 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 190/384] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:53 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:53.928681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ef132d60-54e0-4b64-967d-f175c90a1c2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:53.939418 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ef132d60-54e0-4b64-967d-f175c90a1c2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1723 microversion: 2.1 time: 0.307291 Jul 18 02:37:53.949773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 195/385] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:53 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:54.572441 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9be0e84b-f54d-400e-ab94-aa4d76e8137c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:54.574930 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9be0e84b-f54d-400e-ab94-aa4d76e8137c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:54.582737 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9be0e84b-f54d-400e-ab94-aa4d76e8137c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.583368 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9be0e84b-f54d-400e-ab94-aa4d76e8137c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.585365 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9be0e84b-f54d-400e-ab94-aa4d76e8137c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.585803 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9be0e84b-f54d-400e-ab94-aa4d76e8137c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.621093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0c98b3da-e86b-47b0-8f30-d1c4fec168b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:54.622280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0c98b3da-e86b-47b0-8f30-d1c4fec168b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:54.629360 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c98b3da-e86b-47b0-8f30-d1c4fec168b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.631601 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c98b3da-e86b-47b0-8f30-d1c4fec168b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.632022 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c98b3da-e86b-47b0-8f30-d1c4fec168b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.632624 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c98b3da-e86b-47b0-8f30-d1c4fec168b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.782641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9be0e84b-f54d-400e-ab94-aa4d76e8137c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.792791 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9be0e84b-f54d-400e-ab94-aa4d76e8137c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.795414 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9be0e84b-f54d-400e-ab94-aa4d76e8137c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.796853 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9be0e84b-f54d-400e-ab94-aa4d76e8137c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1740 microversion: 2.20 time: 0.230631 Jul 18 02:37:54.811260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 191/386] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:54 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:54.815173 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-e04a746a-42db-4320-8e7a-69c5d7b42021 req-19c4dc0d-39d4-43a3-90ff-2d1d9ee2a4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8efcc0a9-9d1f-43e8-998e-c6bd700bd24b", "name": "network-vif-deleted", "tag": "8cc1584e-f2f7-4312-b8f9-de762dbe75f4"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:54.825573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-e04a746a-42db-4320-8e7a-69c5d7b42021 req-19c4dc0d-39d4-43a3-90ff-2d1d9ee2a4c0 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.826391 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-e04a746a-42db-4320-8e7a-69c5d7b42021 req-19c4dc0d-39d4-43a3-90ff-2d1d9ee2a4c0 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.840348 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-e04a746a-42db-4320-8e7a-69c5d7b42021 req-19c4dc0d-39d4-43a3-90ff-2d1d9ee2a4c0 service nova] Creating event network-vif-deleted:8cc1584e-f2f7-4312-b8f9-de762dbe75f4 for instance 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b on hv-cinder-85001 Jul 18 02:37:54.845961 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-e04a746a-42db-4320-8e7a-69c5d7b42021 req-19c4dc0d-39d4-43a3-90ff-2d1d9ee2a4c0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035317 Jul 18 02:37:54.846946 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 192/387] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:37:54.869313 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0c98b3da-e86b-47b0-8f30-d1c4fec168b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:54.877829 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0c98b3da-e86b-47b0-8f30-d1c4fec168b7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1515 microversion: 2.1 time: 0.264710 Jul 18 02:37:54.878440 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 196/388] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:54 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:54.894420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f362ce13-cac7-4d4c-94b7-c8d8b1c9f90b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:54.895498 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f362ce13-cac7-4d4c-94b7-c8d8b1c9f90b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:54.903535 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f362ce13-cac7-4d4c-94b7-c8d8b1c9f90b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.904121 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f362ce13-cac7-4d4c-94b7-c8d8b1c9f90b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.905059 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f362ce13-cac7-4d4c-94b7-c8d8b1c9f90b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.905648 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f362ce13-cac7-4d4c-94b7-c8d8b1c9f90b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.956758 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-84ddbb1f-aaaa-40ec-8c4d-c67c44611ffd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:54.957670 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-84ddbb1f-aaaa-40ec-8c4d-c67c44611ffd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:54.966624 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-84ddbb1f-aaaa-40ec-8c4d-c67c44611ffd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.967377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-84ddbb1f-aaaa-40ec-8c4d-c67c44611ffd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:54.968460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-84ddbb1f-aaaa-40ec-8c4d-c67c44611ffd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:54.969106 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-84ddbb1f-aaaa-40ec-8c4d-c67c44611ffd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.043000 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f362ce13-cac7-4d4c-94b7-c8d8b1c9f90b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:55.055444 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f362ce13-cac7-4d4c-94b7-c8d8b1c9f90b tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1463 microversion: 2.1 time: 0.165887 Jul 18 02:37:55.067059 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 193/389] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:54 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1463 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:55.170313 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-84ddbb1f-aaaa-40ec-8c4d-c67c44611ffd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:55.179044 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-84ddbb1f-aaaa-40ec-8c4d-c67c44611ffd tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1700 microversion: 2.1 time: 0.226260 Jul 18 02:37:55.179618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 197/390] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:54 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1700 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:37:55.197943 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-774a60bd-2441-478e-bfa5-d8c439d5424a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:55.204237 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-774a60bd-2441-478e-bfa5-d8c439d5424a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.205062 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-774a60bd-2441-478e-bfa5-d8c439d5424a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.279324 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-774a60bd-2441-478e-bfa5-d8c439d5424a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Going to try to start instance {{(pid=124890) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 02:37:55.524334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-774a60bd-2441-478e-bfa5-d8c439d5424a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/action" status: 202 len: 0 microversion: 2.1 time: 0.323798 Jul 18 02:37:55.524334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 194/391] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:37:55 2022] POST /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:37:55.534987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2a205fd6-5f65-437d-a39f-c05c26d9897c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:55.535439 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2a205fd6-5f65-437d-a39f-c05c26d9897c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:55.570944 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2a205fd6-5f65-437d-a39f-c05c26d9897c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.571171 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2a205fd6-5f65-437d-a39f-c05c26d9897c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.571987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2a205fd6-5f65-437d-a39f-c05c26d9897c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.572437 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2a205fd6-5f65-437d-a39f-c05c26d9897c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.781837 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-2a205fd6-5f65-437d-a39f-c05c26d9897c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:55.796531 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2a205fd6-5f65-437d-a39f-c05c26d9897c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1709 microversion: 2.1 time: 0.265799 Jul 18 02:37:55.797133 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 198/392] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:55 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1709 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:55.817144 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e1136f80-fa6f-4ca3-b2ee-d8c39643c92c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:55.817844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e1136f80-fa6f-4ca3-b2ee-d8c39643c92c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:55.824580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1136f80-fa6f-4ca3-b2ee-d8c39643c92c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.825359 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1136f80-fa6f-4ca3-b2ee-d8c39643c92c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.825809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1136f80-fa6f-4ca3-b2ee-d8c39643c92c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:55.826272 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1136f80-fa6f-4ca3-b2ee-d8c39643c92c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:55.990685 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e1136f80-fa6f-4ca3-b2ee-d8c39643c92c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:55.999082 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e1136f80-fa6f-4ca3-b2ee-d8c39643c92c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:56.003096 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e1136f80-fa6f-4ca3-b2ee-d8c39643c92c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:56.003096 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e1136f80-fa6f-4ca3-b2ee-d8c39643c92c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1722 microversion: 2.20 time: 0.189559 Jul 18 02:37:56.003096 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 195/393] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:55 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:56.073449 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:56.074050 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:56.080043 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:56.080486 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:56.081237 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:56.081668 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:56.085018 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:56.114503 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:56.118927 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:56.119368 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:56.119817 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lazy-loading 'fault' on Instance uuid 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:37:56.222720 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9949aaf5749c9b00e1e04171e6f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd615520de8a64205981c88430498f5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:56.232794 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c3f08ff7-d1ae-4fb0-bffb-12393c0dd5ba tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 200 len: 1304 microversion: 2.1 time: 0.163251 Jul 18 02:37:56.233605 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 199/394] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:56 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:56.815345 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9905b2a3-ab89-41cc-819e-30335c08ee06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:56.816697 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9905b2a3-ab89-41cc-819e-30335c08ee06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:56.822489 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9905b2a3-ab89-41cc-819e-30335c08ee06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:56.823545 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9905b2a3-ab89-41cc-819e-30335c08ee06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:56.823688 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9905b2a3-ab89-41cc-819e-30335c08ee06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:56.824347 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9905b2a3-ab89-41cc-819e-30335c08ee06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:56.828858 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:56.983614 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9905b2a3-ab89-41cc-819e-30335c08ee06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:56.993423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9905b2a3-ab89-41cc-819e-30335c08ee06 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1709 microversion: 2.1 time: 0.182065 Jul 18 02:37:57.004384 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 196/395] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:56 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1709 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:57.021637 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4f4e35fd-1031-45e0-853b-28f00e55655b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:57.022680 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4f4e35fd-1031-45e0-853b-28f00e55655b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:57.031791 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4f4e35fd-1031-45e0-853b-28f00e55655b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.032223 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4f4e35fd-1031-45e0-853b-28f00e55655b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.033009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4f4e35fd-1031-45e0-853b-28f00e55655b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.033448 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4f4e35fd-1031-45e0-853b-28f00e55655b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.166978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4f4e35fd-1031-45e0-853b-28f00e55655b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:57.175472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4f4e35fd-1031-45e0-853b-28f00e55655b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:57.176960 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4f4e35fd-1031-45e0-853b-28f00e55655b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:57.178594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4f4e35fd-1031-45e0-853b-28f00e55655b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1722 microversion: 2.20 time: 0.160677 Jul 18 02:37:57.179163 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 200/396] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:57 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:57.250896 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6689ed9a-68ab-4e79-a84e-4454fe9f5592 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:57.251628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6689ed9a-68ab-4e79-a84e-4454fe9f5592 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] [instance: 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:57.258651 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6689ed9a-68ab-4e79-a84e-4454fe9f5592 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.259166 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6689ed9a-68ab-4e79-a84e-4454fe9f5592 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.264945 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6689ed9a-68ab-4e79-a84e-4454fe9f5592 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:57.264945 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6689ed9a-68ab-4e79-a84e-4454fe9f5592 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:57.274353 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-6689ed9a-68ab-4e79-a84e-4454fe9f5592 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] HTTP exception thrown: Instance 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b could not be found. Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6689ed9a-68ab-4e79-a84e-4454fe9f5592 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Request method failure captured: Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b HTTP/1.1 Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MdFCCg1I9ms6pEPQym6EPsQAmqAnsOKttRtW6OvcEVzw1hp-I8fjZVf4ofWCrClUI5RaJ2GqKIxKx5rVOaGOctVYKiC6Q-VLt2tZBPQXd7o35xwSFXOMqrbFrlzEMoq4p4grNWiNqF7VACjlMWIbqE8CT3uymzSdJmlIIPtAOgRMSA Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: d615520de8a64205981c88430498f5f6 Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-VolumesActionsTest-874403558 Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:37:57.276204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d615520de8a64205981c88430498f5f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d615520de8a64205981c88430498f5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d615520de8a64205981c88430498f5f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d615520de8a64205981c88430498f5f6", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-VolumesActionsTest-874403558 Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: d615520de8a64205981c88430498f5f6 Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-VolumesActionsTest-874403558 Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-VolumesActionsTest-874403558-project Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 86d9949aaf5749c9b00e1e04171e6f93 Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-VolumesActionsTest-874403558-project Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b could not be found. Jul 18 02:37:57.277757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '8efcc0a9-9d1f-43e8-998e-c6bd700bd24b'} Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b could not be found. Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:37:57.278709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b could not be found. Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b could not be found. Jul 18 02:37:57.280143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:37:57.281422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6689ed9a-68ab-4e79-a84e-4454fe9f5592 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] Returning 404 to user: Instance 8efcc0a9-9d1f-43e8-998e-c6bd700bd24b could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:37:57.281422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6689ed9a-68ab-4e79-a84e-4454fe9f5592 tempest-VolumesActionsTest-874403558 tempest-VolumesActionsTest-874403558-project] 10.222.0.66 "GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b" status: 404 len: 111 microversion: 2.1 time: 0.030591 Jul 18 02:37:57.281422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 197/397] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:57 2022] GET /compute/v2.1/servers/8efcc0a9-9d1f-43e8-998e-c6bd700bd24b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:37:57.852970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1652131948", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:57.902534 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d812d6ab-2441-4dc9-a743-208dc30c213f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'create', calling method: .version_select at 0x7f28edf73820>, body: {"keypair": {"name": "tempest-keypair-788002199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDTwfkrFMkarRCfVdF2EjEY3avP9N/PswY45K5mvEaeWr6XL9u0MV5+w0IcJy6iWNVaw/M6g2WBMWKp+1f1hAgZ1hXsFn4E9O1EYt6ZvNAeyuE+k1S8hsHRANt5hkOvJQ=="}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:37:57.909904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] validate_networks() for None {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:37:57.926551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-d812d6ab-2441-4dc9-a743-208dc30c213f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Getting quotas for project 9ec4c1c1687944b98c1c5cefe05df095. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:57.931271 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-d812d6ab-2441-4dc9-a743-208dc30c213f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Getting quotas for user d281c92e20d04004a679a8ec65f9e6d5 and project 9ec4c1c1687944b98c1c5cefe05df095. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:58.051991 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d812d6ab-2441-4dc9-a743-208dc30c213f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157921 Jul 18 02:37:58.063955 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 198/398] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 18 02:37:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:37:58.066352 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2fda7695-de37-412b-bd6a-bf3d20feca6b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:58.067041 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2fda7695-de37-412b-bd6a-bf3d20feca6b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:58.077313 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2fda7695-de37-412b-bd6a-bf3d20feca6b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.077774 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2fda7695-de37-412b-bd6a-bf3d20feca6b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.078583 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2fda7695-de37-412b-bd6a-bf3d20feca6b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.079020 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2fda7695-de37-412b-bd6a-bf3d20feca6b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.229847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2fda7695-de37-412b-bd6a-bf3d20feca6b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:58.238618 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2fda7695-de37-412b-bd6a-bf3d20feca6b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1709 microversion: 2.1 time: 0.176643 Jul 18 02:37:58.239870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 199/399] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:58 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:58.262071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-26c72749-c0e9-4cc6-8e34-01bc760ba259 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:58.262780 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-26c72749-c0e9-4cc6-8e34-01bc760ba259 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:58.269528 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-26c72749-c0e9-4cc6-8e34-01bc760ba259 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.269977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-26c72749-c0e9-4cc6-8e34-01bc760ba259 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.270803 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-26c72749-c0e9-4cc6-8e34-01bc760ba259 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.272003 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-26c72749-c0e9-4cc6-8e34-01bc760ba259 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.415971 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-26c72749-c0e9-4cc6-8e34-01bc760ba259 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:58.424980 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-26c72749-c0e9-4cc6-8e34-01bc760ba259 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:58.426502 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-26c72749-c0e9-4cc6-8e34-01bc760ba259 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:58.428145 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-26c72749-c0e9-4cc6-8e34-01bc760ba259 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1722 microversion: 2.20 time: 0.176706 Jul 18 02:37:58.438891 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 200/400] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:58 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:58.501209 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:37:58.501698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:37:58.505013 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:37:58.505013 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:37:58.505013 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:37:58.512603 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.513048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.513851 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:58.514330 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:58.531314 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Getting quotas for project ba114b0e00424785a219aa31d987d2ee. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:37:58.535316 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Getting quotas for user 273664a60a334dc58ede22f9ccc0a128 and project ba114b0e00424785a219aa31d987d2ee. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:37:58.547292 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:37:58.550376 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:37:58.736880 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c021aaa3-53af-4712-8a13-41eeb38118ec tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.887868 Jul 18 02:37:58.739052 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 201/401] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:37:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:37:58.751080 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-91e8b71b-5375-4fcd-856c-121c4e01fc7c tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:58.751753 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-91e8b71b-5375-4fcd-856c-121c4e01fc7c tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:58.817394 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-91e8b71b-5375-4fcd-856c-121c4e01fc7c tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:58.826988 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-91e8b71b-5375-4fcd-856c-121c4e01fc7c tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1215 microversion: 2.1 time: 0.081660 Jul 18 02:37:58.827716 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 201/402] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:58 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:59.258224 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5cabeac3-f539-469d-b3d5-25da83922cc2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:59.258848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5cabeac3-f539-469d-b3d5-25da83922cc2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:59.265536 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5cabeac3-f539-469d-b3d5-25da83922cc2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:59.265989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5cabeac3-f539-469d-b3d5-25da83922cc2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:59.266808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5cabeac3-f539-469d-b3d5-25da83922cc2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:59.267352 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5cabeac3-f539-469d-b3d5-25da83922cc2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:59.412464 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5cabeac3-f539-469d-b3d5-25da83922cc2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:59.419786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5cabeac3-f539-469d-b3d5-25da83922cc2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1709 microversion: 2.1 time: 0.166783 Jul 18 02:37:59.420376 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 202/403] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:59 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1709 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:37:59.447105 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-009fe4a7-d08c-4451-a175-a0bce7d63c51 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:59.447723 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-009fe4a7-d08c-4451-a175-a0bce7d63c51 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:59.454304 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-009fe4a7-d08c-4451-a175-a0bce7d63c51 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:59.454760 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-009fe4a7-d08c-4451-a175-a0bce7d63c51 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:59.455528 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-009fe4a7-d08c-4451-a175-a0bce7d63c51 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:37:59.455978 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-009fe4a7-d08c-4451-a175-a0bce7d63c51 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:37:59.641258 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-009fe4a7-d08c-4451-a175-a0bce7d63c51 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:59.649552 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-009fe4a7-d08c-4451-a175-a0bce7d63c51 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:59.651172 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-009fe4a7-d08c-4451-a175-a0bce7d63c51 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:59.652321 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-009fe4a7-d08c-4451-a175-a0bce7d63c51 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1722 microversion: 2.20 time: 0.209900 Jul 18 02:37:59.652887 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 202/404] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:37:59 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:37:59.844889 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3ac8ff54-aebd-4d9d-9779-4dc2a299efd8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:37:59.845521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3ac8ff54-aebd-4d9d-9779-4dc2a299efd8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:37:59.908600 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3ac8ff54-aebd-4d9d-9779-4dc2a299efd8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:37:59.916223 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3ac8ff54-aebd-4d9d-9779-4dc2a299efd8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1215 microversion: 2.1 time: 0.075242 Jul 18 02:37:59.916792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 203/405] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:37:59 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:00.437713 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a185f63b-a63b-4ebf-a212-80a0e6bd1f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:00.438626 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a185f63b-a63b-4ebf-a212-80a0e6bd1f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:00.444641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a185f63b-a63b-4ebf-a212-80a0e6bd1f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.445091 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a185f63b-a63b-4ebf-a212-80a0e6bd1f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:00.445863 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a185f63b-a63b-4ebf-a212-80a0e6bd1f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.446321 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a185f63b-a63b-4ebf-a212-80a0e6bd1f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:00.591966 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a185f63b-a63b-4ebf-a212-80a0e6bd1f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:00.599657 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a185f63b-a63b-4ebf-a212-80a0e6bd1f9f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1709 microversion: 2.1 time: 0.165851 Jul 18 02:38:00.609444 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 203/406] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:00 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:00.671273 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ea7c1e57-e0d7-436f-a30a-7f0a47790222 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:00.671880 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ea7c1e57-e0d7-436f-a30a-7f0a47790222 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:00.679747 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea7c1e57-e0d7-436f-a30a-7f0a47790222 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.680197 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea7c1e57-e0d7-436f-a30a-7f0a47790222 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:00.680968 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea7c1e57-e0d7-436f-a30a-7f0a47790222 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.681395 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea7c1e57-e0d7-436f-a30a-7f0a47790222 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:00.870048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ea7c1e57-e0d7-436f-a30a-7f0a47790222 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:00.878052 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ea7c1e57-e0d7-436f-a30a-7f0a47790222 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:00.879674 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ea7c1e57-e0d7-436f-a30a-7f0a47790222 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:00.880832 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ea7c1e57-e0d7-436f-a30a-7f0a47790222 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1722 microversion: 2.20 time: 0.213461 Jul 18 02:38:00.882072 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 204/407] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:00 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:00.933393 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4e222fef-a31e-4294-b4ec-101619e9a154 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:00.934025 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4e222fef-a31e-4294-b4ec-101619e9a154 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:00.939979 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e222fef-a31e-4294-b4ec-101619e9a154 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.940416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e222fef-a31e-4294-b4ec-101619e9a154 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:00.941176 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e222fef-a31e-4294-b4ec-101619e9a154 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:00.941615 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e222fef-a31e-4294-b4ec-101619e9a154 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.006695 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4e222fef-a31e-4294-b4ec-101619e9a154 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:01.014065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4e222fef-a31e-4294-b4ec-101619e9a154 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1219 microversion: 2.1 time: 0.084564 Jul 18 02:38:01.014651 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 204/408] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:00 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:01.388989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-244425116", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e66762c-c4d2-46f6-ba12-585a390bb14c"}], "security_groups": [{"name": "tempest-securitygroup--1366705400"}], "key_name": "tempest-keypair-788002199", "user_data": "}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:01.494064 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] validate_networks() for [('9e66762c-c4d2-46f6-ba12-585a390bb14c', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:38:01.617064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e2372914-13a1-4340-8919-a32073d9f0ed tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:01.617677 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e2372914-13a1-4340-8919-a32073d9f0ed tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:01.624213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e2372914-13a1-4340-8919-a32073d9f0ed tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.624664 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e2372914-13a1-4340-8919-a32073d9f0ed tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.625634 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e2372914-13a1-4340-8919-a32073d9f0ed tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.626072 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e2372914-13a1-4340-8919-a32073d9f0ed tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.763204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e2372914-13a1-4340-8919-a32073d9f0ed tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:01.771305 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e2372914-13a1-4340-8919-a32073d9f0ed tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1709 microversion: 2.1 time: 0.158485 Jul 18 02:38:01.772094 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 205/409] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:01 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:01.880264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:38:01.880845 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:38:01.881952 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:38:01.882410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:38:01.882889 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:38:01.891554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.892004 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.892810 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.893252 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.900407 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d76bf295-1a0e-4645-96a2-40f50a264c2e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:01.901020 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d76bf295-1a0e-4645-96a2-40f50a264c2e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:01.906924 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d76bf295-1a0e-4645-96a2-40f50a264c2e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.907377 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d76bf295-1a0e-4645-96a2-40f50a264c2e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.908143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d76bf295-1a0e-4645-96a2-40f50a264c2e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:01.908578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d76bf295-1a0e-4645-96a2-40f50a264c2e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:01.910475 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Getting quotas for project 9ec4c1c1687944b98c1c5cefe05df095. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:38:01.914811 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Getting quotas for user d281c92e20d04004a679a8ec65f9e6d5 and project 9ec4c1c1687944b98c1c5cefe05df095. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:38:01.925723 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:38:01.927900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:38:02.042422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d76bf295-1a0e-4645-96a2-40f50a264c2e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.051072 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d76bf295-1a0e-4645-96a2-40f50a264c2e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.052588 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d76bf295-1a0e-4645-96a2-40f50a264c2e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.054049 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d76bf295-1a0e-4645-96a2-40f50a264c2e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1725 microversion: 2.20 time: 0.158309 Jul 18 02:38:02.054796 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 206/410] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:01 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:02.070610 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-03a92194-481b-406d-b012-30d935a51c7e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:02.074975 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-03a92194-481b-406d-b012-30d935a51c7e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:02.090927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-03a92194-481b-406d-b012-30d935a51c7e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.091552 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-03a92194-481b-406d-b012-30d935a51c7e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.092479 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-03a92194-481b-406d-b012-30d935a51c7e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.093023 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-03a92194-481b-406d-b012-30d935a51c7e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.149282 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9f236722-c56b-47d2-9e9a-644292263bef tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.764486 Jul 18 02:38:02.150129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 205/411] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:38:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:38:02.159125 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-36015bc1-c2a6-402b-9b79-2811164e03da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f1560e6-e4f6-49a3-844c-fe7bc9d5d1d9"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:02.160242 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-36015bc1-c2a6-402b-9b79-2811164e03da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:02.166524 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-03a92194-481b-406d-b012-30d935a51c7e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.176028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-36015bc1-c2a6-402b-9b79-2811164e03da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.176498 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-03a92194-481b-406d-b012-30d935a51c7e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1219 microversion: 2.1 time: 0.119739 Jul 18 02:38:02.177614 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 207/412] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:02 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:02.179249 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-36015bc1-c2a6-402b-9b79-2811164e03da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.180056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-36015bc1-c2a6-402b-9b79-2811164e03da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.180492 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-36015bc1-c2a6-402b-9b79-2811164e03da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.183318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-ab04f887-f269-4961-bde1-fc1f015373cf req-5672869d-1704-483a-b1a6-6f4bb0f6fbba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d974b9-4abf-4d7f-bbea-08e8fef381dd", "name": "network-vif-unplugged", "status": "completed", "tag": "3185ab6e-a508-4ad1-b269-07229430860b"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:02.191877 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-ab04f887-f269-4961-bde1-fc1f015373cf req-5672869d-1704-483a-b1a6-6f4bb0f6fbba service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.194000 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-ab04f887-f269-4961-bde1-fc1f015373cf req-5672869d-1704-483a-b1a6-6f4bb0f6fbba service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.208026 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-ab04f887-f269-4961-bde1-fc1f015373cf req-5672869d-1704-483a-b1a6-6f4bb0f6fbba service nova] Creating event network-vif-unplugged:3185ab6e-a508-4ad1-b269-07229430860b for instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd on hv-cinder-85001 Jul 18 02:38:02.213950 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-ab04f887-f269-4961-bde1-fc1f015373cf req-5672869d-1704-483a-b1a6-6f4bb0f6fbba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034811 Jul 18 02:38:02.215758 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 208/413] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:02.223143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-48497441-2e39-4e73-bec7-0546cc9e2522 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:02.226070 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-48497441-2e39-4e73-bec7-0546cc9e2522 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:02.303043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-48497441-2e39-4e73-bec7-0546cc9e2522 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.324621 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-48497441-2e39-4e73-bec7-0546cc9e2522 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1244 microversion: 2.1 time: 0.107055 Jul 18 02:38:02.325929 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 209/414] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:02 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:02.789911 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-654ae3b5-5291-4580-9aac-1462df9b3b46 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:02.790631 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-654ae3b5-5291-4580-9aac-1462df9b3b46 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:02.798131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-654ae3b5-5291-4580-9aac-1462df9b3b46 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.798591 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-654ae3b5-5291-4580-9aac-1462df9b3b46 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.799395 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-654ae3b5-5291-4580-9aac-1462df9b3b46 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:02.799830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-654ae3b5-5291-4580-9aac-1462df9b3b46 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:02.939014 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-654ae3b5-5291-4580-9aac-1462df9b3b46 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:02.947092 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-654ae3b5-5291-4580-9aac-1462df9b3b46 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1713 microversion: 2.1 time: 0.161893 Jul 18 02:38:02.947652 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 210/415] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:02 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1713 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:03.193302 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3b35c4f2-8323-43f0-9a1c-310ad5362c38 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:03.194733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3b35c4f2-8323-43f0-9a1c-310ad5362c38 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:03.200681 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3b35c4f2-8323-43f0-9a1c-310ad5362c38 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.201174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3b35c4f2-8323-43f0-9a1c-310ad5362c38 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.201941 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3b35c4f2-8323-43f0-9a1c-310ad5362c38 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.202435 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3b35c4f2-8323-43f0-9a1c-310ad5362c38 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.265333 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3b35c4f2-8323-43f0-9a1c-310ad5362c38 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:03.273793 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3b35c4f2-8323-43f0-9a1c-310ad5362c38 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1211 microversion: 2.1 time: 0.084280 Jul 18 02:38:03.274380 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 211/416] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:03 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:03.341875 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-481a530e-7f1e-4996-9033-a168d422298d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:03.342471 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-481a530e-7f1e-4996-9033-a168d422298d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:03.348641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-481a530e-7f1e-4996-9033-a168d422298d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.349093 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-481a530e-7f1e-4996-9033-a168d422298d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.349858 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-481a530e-7f1e-4996-9033-a168d422298d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.350394 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-481a530e-7f1e-4996-9033-a168d422298d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.378867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-36015bc1-c2a6-402b-9b79-2811164e03da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "POST /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.227577 Jul 18 02:38:03.385417 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 206/417] 10.222.0.66 () {62 vars in 1363 bytes} [Mon Jul 18 02:38:02 2022] POST /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments => generated 188 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:38:03.414711 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-481a530e-7f1e-4996-9033-a168d422298d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:03.423287 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-481a530e-7f1e-4996-9033-a168d422298d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1248 microversion: 2.1 time: 0.084944 Jul 18 02:38:03.424319 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 212/418] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:03 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:03.502843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-da7aacc6-3126-4557-a204-d35c58e31a44 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:03.503725 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-da7aacc6-3126-4557-a204-d35c58e31a44 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:03.510935 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da7aacc6-3126-4557-a204-d35c58e31a44 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.511621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da7aacc6-3126-4557-a204-d35c58e31a44 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:03.512556 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da7aacc6-3126-4557-a204-d35c58e31a44 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:03.513147 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da7aacc6-3126-4557-a204-d35c58e31a44 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.000599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-da7aacc6-3126-4557-a204-d35c58e31a44 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "POST /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/action" status: 202 len: 0 microversion: 2.20 time: 0.503155 Jul 18 02:38:04.001206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 207/419] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Jul 18 02:38:03 2022] POST /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:38:04.010644 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-61f7b76c-01be-4603-9f5a-3d8ab4672527 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:04.011272 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-61f7b76c-01be-4603-9f5a-3d8ab4672527 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:04.018074 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-61f7b76c-01be-4603-9f5a-3d8ab4672527 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.019348 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-61f7b76c-01be-4603-9f5a-3d8ab4672527 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.019452 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-61f7b76c-01be-4603-9f5a-3d8ab4672527 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.019947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-61f7b76c-01be-4603-9f5a-3d8ab4672527 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.214358 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-61f7b76c-01be-4603-9f5a-3d8ab4672527 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.226662 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-61f7b76c-01be-4603-9f5a-3d8ab4672527 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.228640 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-61f7b76c-01be-4603-9f5a-3d8ab4672527 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.230280 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-61f7b76c-01be-4603-9f5a-3d8ab4672527 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1751 microversion: 2.20 time: 0.224500 Jul 18 02:38:04.233438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 213/420] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:04 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:04.292264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-54cf741b-ef4e-4fd6-8aa4-05df958c9347 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:04.293173 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-54cf741b-ef4e-4fd6-8aa4-05df958c9347 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:04.300889 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-54cf741b-ef4e-4fd6-8aa4-05df958c9347 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.301578 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-54cf741b-ef4e-4fd6-8aa4-05df958c9347 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.302772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-54cf741b-ef4e-4fd6-8aa4-05df958c9347 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.303427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-54cf741b-ef4e-4fd6-8aa4-05df958c9347 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.376874 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-54cf741b-ef4e-4fd6-8aa4-05df958c9347 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.387227 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-54cf741b-ef4e-4fd6-8aa4-05df958c9347 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1267 microversion: 2.1 time: 0.099670 Jul 18 02:38:04.389027 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 208/421] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:04 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:04.441274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-77ee4182-d9b5-4d8e-ba73-5a7a098c3a1f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:04.442203 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-77ee4182-d9b5-4d8e-ba73-5a7a098c3a1f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:04.452340 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-77ee4182-d9b5-4d8e-ba73-5a7a098c3a1f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.452791 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-77ee4182-d9b5-4d8e-ba73-5a7a098c3a1f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.453633 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-77ee4182-d9b5-4d8e-ba73-5a7a098c3a1f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:04.454074 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-77ee4182-d9b5-4d8e-ba73-5a7a098c3a1f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:04.547602 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-77ee4182-d9b5-4d8e-ba73-5a7a098c3a1f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:04.556908 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-77ee4182-d9b5-4d8e-ba73-5a7a098c3a1f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1296 microversion: 2.1 time: 0.119724 Jul 18 02:38:04.557724 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 214/422] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:04 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:05.253727 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7fa50bed-144c-4346-8de7-c24c8ba9881b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:05.254614 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7fa50bed-144c-4346-8de7-c24c8ba9881b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:05.265006 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7fa50bed-144c-4346-8de7-c24c8ba9881b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.265849 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7fa50bed-144c-4346-8de7-c24c8ba9881b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.267135 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7fa50bed-144c-4346-8de7-c24c8ba9881b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.267592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7fa50bed-144c-4346-8de7-c24c8ba9881b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.409680 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8f680ad5-e4f0-4e73-8056-106ccaf9c70b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:05.411066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8f680ad5-e4f0-4e73-8056-106ccaf9c70b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:05.427908 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f680ad5-e4f0-4e73-8056-106ccaf9c70b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.429404 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f680ad5-e4f0-4e73-8056-106ccaf9c70b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.431537 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f680ad5-e4f0-4e73-8056-106ccaf9c70b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.432753 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f680ad5-e4f0-4e73-8056-106ccaf9c70b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.503831 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7fa50bed-144c-4346-8de7-c24c8ba9881b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:05.510184 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8f680ad5-e4f0-4e73-8056-106ccaf9c70b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:05.513441 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7fa50bed-144c-4346-8de7-c24c8ba9881b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:05.515060 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7fa50bed-144c-4346-8de7-c24c8ba9881b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:05.516791 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7fa50bed-144c-4346-8de7-c24c8ba9881b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1751 microversion: 2.20 time: 0.266773 Jul 18 02:38:05.517520 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 209/423] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:05 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1751 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:05.520115 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8f680ad5-e4f0-4e73-8056-106ccaf9c70b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1273 microversion: 2.1 time: 0.116089 Jul 18 02:38:05.532529 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 215/424] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:05 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:05.576589 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-58195c75-695d-40fc-bbe2-48bbdbe79804 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:05.577557 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-58195c75-695d-40fc-bbe2-48bbdbe79804 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:05.584468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58195c75-695d-40fc-bbe2-48bbdbe79804 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.586078 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58195c75-695d-40fc-bbe2-48bbdbe79804 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.587242 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58195c75-695d-40fc-bbe2-48bbdbe79804 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:05.587920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58195c75-695d-40fc-bbe2-48bbdbe79804 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:05.691599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-58195c75-695d-40fc-bbe2-48bbdbe79804 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:05.708409 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-58195c75-695d-40fc-bbe2-48bbdbe79804 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1304 microversion: 2.1 time: 0.135729 Jul 18 02:38:05.718172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 210/425] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:05 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:06.536423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4b90531a-c2df-4b68-8b1c-0d74453d4328 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:06.536973 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4b90531a-c2df-4b68-8b1c-0d74453d4328 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:06.543889 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3f4bd16f-78bd-4012-9d62-c1322772e3e6 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:06.545145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3f4bd16f-78bd-4012-9d62-c1322772e3e6 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:06.555118 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f4bd16f-78bd-4012-9d62-c1322772e3e6 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.555910 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f4bd16f-78bd-4012-9d62-c1322772e3e6 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.556050 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4b90531a-c2df-4b68-8b1c-0d74453d4328 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.556509 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4b90531a-c2df-4b68-8b1c-0d74453d4328 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.557300 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4b90531a-c2df-4b68-8b1c-0d74453d4328 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.557527 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f4bd16f-78bd-4012-9d62-c1322772e3e6 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.557764 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4b90531a-c2df-4b68-8b1c-0d74453d4328 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.558562 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f4bd16f-78bd-4012-9d62-c1322772e3e6 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.805813 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4b90531a-c2df-4b68-8b1c-0d74453d4328 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:06.820074 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4b90531a-c2df-4b68-8b1c-0d74453d4328 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:06.826607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4b90531a-c2df-4b68-8b1c-0d74453d4328 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:06.827209 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4b90531a-c2df-4b68-8b1c-0d74453d4328 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1751 microversion: 2.20 time: 0.295024 Jul 18 02:38:06.829837 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 216/426] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:06 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1751 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:06.839833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-901806a5-3803-42eb-a96f-632c5b67d041 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:06.842916 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-901806a5-3803-42eb-a96f-632c5b67d041 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:06.861069 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-901806a5-3803-42eb-a96f-632c5b67d041 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.861069 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-901806a5-3803-42eb-a96f-632c5b67d041 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.861069 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-901806a5-3803-42eb-a96f-632c5b67d041 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:06.861069 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-901806a5-3803-42eb-a96f-632c5b67d041 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:06.880792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:06.966694 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-901806a5-3803-42eb-a96f-632c5b67d041 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:06.977777 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-901806a5-3803-42eb-a96f-632c5b67d041 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1302 microversion: 2.1 time: 0.141954 Jul 18 02:38:06.978639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 217/427] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:06 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1302 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:07.029777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3f4bd16f-78bd-4012-9d62-c1322772e3e6 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:07.042427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3f4bd16f-78bd-4012-9d62-c1322772e3e6 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.505877 Jul 18 02:38:07.050142 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 211/428] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:06 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:07.848144 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-063cb644-7b5b-4a75-8873-b7ba203289b6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:07.850501 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-063cb644-7b5b-4a75-8873-b7ba203289b6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:07.864601 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-063cb644-7b5b-4a75-8873-b7ba203289b6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:07.865282 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-063cb644-7b5b-4a75-8873-b7ba203289b6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:07.866586 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-063cb644-7b5b-4a75-8873-b7ba203289b6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:07.867411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-063cb644-7b5b-4a75-8873-b7ba203289b6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:07.996442 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-86b386d2-432b-42b6-8a35-c7bc4d2acde6 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:07.997420 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-86b386d2-432b-42b6-8a35-c7bc4d2acde6 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:08.014740 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-86b386d2-432b-42b6-8a35-c7bc4d2acde6 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:08.015632 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-86b386d2-432b-42b6-8a35-c7bc4d2acde6 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.016747 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-86b386d2-432b-42b6-8a35-c7bc4d2acde6 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:08.018361 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-86b386d2-432b-42b6-8a35-c7bc4d2acde6 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.095524 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-063cb644-7b5b-4a75-8873-b7ba203289b6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:08.105449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-063cb644-7b5b-4a75-8873-b7ba203289b6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:08.107043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-063cb644-7b5b-4a75-8873-b7ba203289b6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:08.108055 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-063cb644-7b5b-4a75-8873-b7ba203289b6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1751 microversion: 2.20 time: 0.263859 Jul 18 02:38:08.109072 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 218/429] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:07 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1751 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:08.118936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a11ba91e-3ada-49d1-8974-34815f50bb86 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:08.119478 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a11ba91e-3ada-49d1-8974-34815f50bb86 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:08.131274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a11ba91e-3ada-49d1-8974-34815f50bb86 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:08.131720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a11ba91e-3ada-49d1-8974-34815f50bb86 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.132559 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a11ba91e-3ada-49d1-8974-34815f50bb86 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:08.133000 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a11ba91e-3ada-49d1-8974-34815f50bb86 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:08.333055 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a11ba91e-3ada-49d1-8974-34815f50bb86 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:08.350363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a11ba91e-3ada-49d1-8974-34815f50bb86 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.240103 Jul 18 02:38:08.351173 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 219/430] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:08 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:08.525526 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-86b386d2-432b-42b6-8a35-c7bc4d2acde6 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:08.548413 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-86b386d2-432b-42b6-8a35-c7bc4d2acde6 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.554370 Jul 18 02:38:08.559372 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 212/431] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:07 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:09.093995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-9277311e-9371-4c45-a5bf-e9acf1db4360 req-e3017a5f-daab-46f6-91ba-ea845a6a46d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b571193-bc0c-461f-b2ad-e3c66e93ba5d", "tag": "a7faca7c-8eb7-4b92-a867-ab4fcf1f065a"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:09.111698 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-9277311e-9371-4c45-a5bf-e9acf1db4360 req-e3017a5f-daab-46f6-91ba-ea845a6a46d0 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.120573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-9277311e-9371-4c45-a5bf-e9acf1db4360 req-e3017a5f-daab-46f6-91ba-ea845a6a46d0 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.127946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3cf792a3-6419-443f-a506-901141086a71 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:09.129523 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3cf792a3-6419-443f-a506-901141086a71 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:09.168268 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3cf792a3-6419-443f-a506-901141086a71 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.170884 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3cf792a3-6419-443f-a506-901141086a71 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.172978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3cf792a3-6419-443f-a506-901141086a71 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.173528 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3cf792a3-6419-443f-a506-901141086a71 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.188696 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-9277311e-9371-4c45-a5bf-e9acf1db4360 req-e3017a5f-daab-46f6-91ba-ea845a6a46d0 service nova] Creating event network-changed:a7faca7c-8eb7-4b92-a867-ab4fcf1f065a for instance 8b571193-bc0c-461f-b2ad-e3c66e93ba5d on hv-cinder-85001 Jul 18 02:38:09.199708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-9277311e-9371-4c45-a5bf-e9acf1db4360 req-e3017a5f-daab-46f6-91ba-ea845a6a46d0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109880 Jul 18 02:38:09.202420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 220/432] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:09.368650 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-69ac8980-cc5c-4694-a1dd-6a3e7ab6e891 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:09.370183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-69ac8980-cc5c-4694-a1dd-6a3e7ab6e891 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:09.372736 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:09.378366 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69ac8980-cc5c-4694-a1dd-6a3e7ab6e891 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.378966 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69ac8980-cc5c-4694-a1dd-6a3e7ab6e891 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.380400 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69ac8980-cc5c-4694-a1dd-6a3e7ab6e891 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.381250 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69ac8980-cc5c-4694-a1dd-6a3e7ab6e891 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.503580 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3cf792a3-6419-443f-a506-901141086a71 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.524963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3cf792a3-6419-443f-a506-901141086a71 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.530696 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3cf792a3-6419-443f-a506-901141086a71 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.534304 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3cf792a3-6419-443f-a506-901141086a71 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1751 microversion: 2.20 time: 0.410509 Jul 18 02:38:09.535376 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 213/433] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:09 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1751 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:09.573416 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e0c01fab-7bcc-4326-a5be-b001ca9a7386 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:09.582581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e0c01fab-7bcc-4326-a5be-b001ca9a7386 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:09.592868 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-69ac8980-cc5c-4694-a1dd-6a3e7ab6e891 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.605782 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e0c01fab-7bcc-4326-a5be-b001ca9a7386 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.607440 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-69ac8980-cc5c-4694-a1dd-6a3e7ab6e891 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.243954 Jul 18 02:38:09.607987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e0c01fab-7bcc-4326-a5be-b001ca9a7386 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.608408 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 221/434] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:09 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:09.615497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e0c01fab-7bcc-4326-a5be-b001ca9a7386 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:09.616537 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e0c01fab-7bcc-4326-a5be-b001ca9a7386 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:09.647336 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:09.868294 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e0c01fab-7bcc-4326-a5be-b001ca9a7386 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:09.885245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e0c01fab-7bcc-4326-a5be-b001ca9a7386 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.316933 Jul 18 02:38:09.886067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 214/435] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:09 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:10.559329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-af42744f-f39e-4e94-9a7a-5d96ba573aa5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:10.564040 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-af42744f-f39e-4e94-9a7a-5d96ba573aa5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:10.588497 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-af42744f-f39e-4e94-9a7a-5d96ba573aa5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.589142 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-af42744f-f39e-4e94-9a7a-5d96ba573aa5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.590070 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-af42744f-f39e-4e94-9a7a-5d96ba573aa5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.590811 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-af42744f-f39e-4e94-9a7a-5d96ba573aa5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.630926 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-27cc0aa0-ea03-4845-ae41-51f95cfae36b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:10.632191 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-27cc0aa0-ea03-4845-ae41-51f95cfae36b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:10.639381 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27cc0aa0-ea03-4845-ae41-51f95cfae36b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.640078 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27cc0aa0-ea03-4845-ae41-51f95cfae36b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.641012 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27cc0aa0-ea03-4845-ae41-51f95cfae36b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.641606 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27cc0aa0-ea03-4845-ae41-51f95cfae36b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.810327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-af42744f-f39e-4e94-9a7a-5d96ba573aa5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:10.820431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-af42744f-f39e-4e94-9a7a-5d96ba573aa5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:10.822854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-af42744f-f39e-4e94-9a7a-5d96ba573aa5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:10.824143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-af42744f-f39e-4e94-9a7a-5d96ba573aa5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1751 microversion: 2.20 time: 0.273308 Jul 18 02:38:10.834809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 222/436] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:10 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1751 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:10.903073 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-14c0e35e-ab5c-46b4-84ec-f6a6a8eb761c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:10.904384 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-14c0e35e-ab5c-46b4-84ec-f6a6a8eb761c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:10.911952 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-14c0e35e-ab5c-46b4-84ec-f6a6a8eb761c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.914381 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-14c0e35e-ab5c-46b4-84ec-f6a6a8eb761c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.915162 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-14c0e35e-ab5c-46b4-84ec-f6a6a8eb761c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:10.915937 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-14c0e35e-ab5c-46b4-84ec-f6a6a8eb761c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:10.985154 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-27cc0aa0-ea03-4845-ae41-51f95cfae36b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:10.997761 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-27cc0aa0-ea03-4845-ae41-51f95cfae36b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.376234 Jul 18 02:38:10.999127 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 215/437] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:10 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:11.098269 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-14c0e35e-ab5c-46b4-84ec-f6a6a8eb761c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:11.106911 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-14c0e35e-ab5c-46b4-84ec-f6a6a8eb761c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.209214 Jul 18 02:38:11.116437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 223/438] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:10 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:11.254398 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-4a2ec68f-e630-46a4-a103-6af880a7f1ac req-424ce1bc-9aaa-41c9-92b3-51f32e02dc05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202ad2e8-7648-4965-afb6-736cb94b74ac", "tag": "b201d32b-4faf-4b5d-b867-467d2b9bcc9a"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:11.266629 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-4a2ec68f-e630-46a4-a103-6af880a7f1ac req-424ce1bc-9aaa-41c9-92b3-51f32e02dc05 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.267092 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-4a2ec68f-e630-46a4-a103-6af880a7f1ac req-424ce1bc-9aaa-41c9-92b3-51f32e02dc05 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.283719 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-4a2ec68f-e630-46a4-a103-6af880a7f1ac req-424ce1bc-9aaa-41c9-92b3-51f32e02dc05 service nova] Creating event network-changed:b201d32b-4faf-4b5d-b867-467d2b9bcc9a for instance 202ad2e8-7648-4965-afb6-736cb94b74ac on hv-cinder-85001 Jul 18 02:38:11.289892 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-4a2ec68f-e630-46a4-a103-6af880a7f1ac req-424ce1bc-9aaa-41c9-92b3-51f32e02dc05 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038282 Jul 18 02:38:11.291042 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 216/439] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:11.843361 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-779f78ad-6ffe-4b70-a067-b4a0fb559866 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:11.844066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-779f78ad-6ffe-4b70-a067-b4a0fb559866 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:11.853920 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-779f78ad-6ffe-4b70-a067-b4a0fb559866 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.854425 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-779f78ad-6ffe-4b70-a067-b4a0fb559866 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:11.855230 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-779f78ad-6ffe-4b70-a067-b4a0fb559866 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:11.855661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-779f78ad-6ffe-4b70-a067-b4a0fb559866 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:12.017022 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1b7dd29e-6498-46e8-b395-0f6dcc139c58 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:12.019010 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1b7dd29e-6498-46e8-b395-0f6dcc139c58 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:12.020032 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-779f78ad-6ffe-4b70-a067-b4a0fb559866 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:12.021646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=4 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:12.022787 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=14 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:12.028640 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1b7dd29e-6498-46e8-b395-0f6dcc139c58 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:12.032130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1b7dd29e-6498-46e8-b395-0f6dcc139c58 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:12.032130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1b7dd29e-6498-46e8-b395-0f6dcc139c58 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:12.032130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1b7dd29e-6498-46e8-b395-0f6dcc139c58 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:12.036194 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-779f78ad-6ffe-4b70-a067-b4a0fb559866 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:12.041982 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-779f78ad-6ffe-4b70-a067-b4a0fb559866 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:12.043770 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-779f78ad-6ffe-4b70-a067-b4a0fb559866 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1751 microversion: 2.20 time: 0.204248 Jul 18 02:38:12.044406 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 224/440] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:11 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:12.125826 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-dd83fa5d-63f1-4f9a-aab2-28a0e9291354 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:12.126709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-dd83fa5d-63f1-4f9a-aab2-28a0e9291354 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:12.138485 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd83fa5d-63f1-4f9a-aab2-28a0e9291354 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:12.138939 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd83fa5d-63f1-4f9a-aab2-28a0e9291354 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:12.139724 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd83fa5d-63f1-4f9a-aab2-28a0e9291354 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:12.140168 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd83fa5d-63f1-4f9a-aab2-28a0e9291354 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:12.198619 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1b7dd29e-6498-46e8-b395-0f6dcc139c58 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:12.207266 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1b7dd29e-6498-46e8-b395-0f6dcc139c58 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.195495 Jul 18 02:38:12.217164 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 217/441] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:12 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:12.290385 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dd83fa5d-63f1-4f9a-aab2-28a0e9291354 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:12.298111 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-dd83fa5d-63f1-4f9a-aab2-28a0e9291354 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.178123 Jul 18 02:38:12.298739 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 225/442] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:12 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:13.065292 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c5f54c52-9851-4fec-bf8e-1574c0086a87 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:13.071577 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c5f54c52-9851-4fec-bf8e-1574c0086a87 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:13.074996 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c5f54c52-9851-4fec-bf8e-1574c0086a87 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.075673 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c5f54c52-9851-4fec-bf8e-1574c0086a87 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.076808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c5f54c52-9851-4fec-bf8e-1574c0086a87 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.077505 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c5f54c52-9851-4fec-bf8e-1574c0086a87 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.223945 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cb8fe48c-7444-4fcb-b0a8-5ce8cb1263db tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:13.224556 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cb8fe48c-7444-4fcb-b0a8-5ce8cb1263db tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:13.227013 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=12 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:13.232970 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cb8fe48c-7444-4fcb-b0a8-5ce8cb1263db tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.234215 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cb8fe48c-7444-4fcb-b0a8-5ce8cb1263db tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.234756 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cb8fe48c-7444-4fcb-b0a8-5ce8cb1263db tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.235439 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cb8fe48c-7444-4fcb-b0a8-5ce8cb1263db tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.252138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c5f54c52-9851-4fec-bf8e-1574c0086a87 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:13.261217 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c5f54c52-9851-4fec-bf8e-1574c0086a87 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:13.263446 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c5f54c52-9851-4fec-bf8e-1574c0086a87 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:13.264576 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c5f54c52-9851-4fec-bf8e-1574c0086a87 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1751 microversion: 2.20 time: 0.203116 Jul 18 02:38:13.275842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 218/443] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:13 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1751 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:13.316621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-41cd783a-dd63-4042-957f-553057a2dac9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:13.317239 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-41cd783a-dd63-4042-957f-553057a2dac9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:13.326821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41cd783a-dd63-4042-957f-553057a2dac9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.327776 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41cd783a-dd63-4042-957f-553057a2dac9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.329030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41cd783a-dd63-4042-957f-553057a2dac9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:13.329567 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41cd783a-dd63-4042-957f-553057a2dac9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:13.391267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cb8fe48c-7444-4fcb-b0a8-5ce8cb1263db tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:13.400772 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cb8fe48c-7444-4fcb-b0a8-5ce8cb1263db tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.180440 Jul 18 02:38:13.401708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 226/444] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:13 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:13.491716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-41cd783a-dd63-4042-957f-553057a2dac9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:13.500410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-41cd783a-dd63-4042-957f-553057a2dac9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.188447 Jul 18 02:38:13.500986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 219/445] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:13 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:14.283981 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ed752554-493c-463d-b918-97d886f4d18f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:14.285245 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-ed752554-493c-463d-b918-97d886f4d18f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:14.292858 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ed752554-493c-463d-b918-97d886f4d18f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.294680 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ed752554-493c-463d-b918-97d886f4d18f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.294680 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ed752554-493c-463d-b918-97d886f4d18f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.294680 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ed752554-493c-463d-b918-97d886f4d18f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.418157 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-733d317a-e316-48ae-b934-d6ba926d9e49 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:14.420654 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-733d317a-e316-48ae-b934-d6ba926d9e49 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:14.432525 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-733d317a-e316-48ae-b934-d6ba926d9e49 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.438593 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-733d317a-e316-48ae-b934-d6ba926d9e49 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.439842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-733d317a-e316-48ae-b934-d6ba926d9e49 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.440449 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-733d317a-e316-48ae-b934-d6ba926d9e49 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.512102 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ed752554-493c-463d-b918-97d886f4d18f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:14.524358 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ed752554-493c-463d-b918-97d886f4d18f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:14.527011 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ed752554-493c-463d-b918-97d886f4d18f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:14.528445 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ed752554-493c-463d-b918-97d886f4d18f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1751 microversion: 2.20 time: 0.248538 Jul 18 02:38:14.529800 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 227/446] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:14 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:14.536281 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cd6b931b-7c01-4414-811d-8ca1c2c26976 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:14.537127 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cd6b931b-7c01-4414-811d-8ca1c2c26976 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:14.544139 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd6b931b-7c01-4414-811d-8ca1c2c26976 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.544790 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd6b931b-7c01-4414-811d-8ca1c2c26976 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.545578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd6b931b-7c01-4414-811d-8ca1c2c26976 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:14.546048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd6b931b-7c01-4414-811d-8ca1c2c26976 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:14.594929 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-733d317a-e316-48ae-b934-d6ba926d9e49 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:14.613126 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-733d317a-e316-48ae-b934-d6ba926d9e49 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.199634 Jul 18 02:38:14.613813 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 220/447] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:14 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:14.684025 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cd6b931b-7c01-4414-811d-8ca1c2c26976 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:14.691370 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cd6b931b-7c01-4414-811d-8ca1c2c26976 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.160418 Jul 18 02:38:14.691940 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 228/448] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:14 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:15.549108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-80d65c9e-86a3-48ad-a83e-8740fa6f9234 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:15.549898 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-80d65c9e-86a3-48ad-a83e-8740fa6f9234 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:15.560217 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-80d65c9e-86a3-48ad-a83e-8740fa6f9234 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.565486 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-80d65c9e-86a3-48ad-a83e-8740fa6f9234 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.565486 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-80d65c9e-86a3-48ad-a83e-8740fa6f9234 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.565486 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-80d65c9e-86a3-48ad-a83e-8740fa6f9234 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.631037 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1e52462b-dcfb-4861-8781-113326e0ebd5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:15.631685 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1e52462b-dcfb-4861-8781-113326e0ebd5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:15.640357 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1e52462b-dcfb-4861-8781-113326e0ebd5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.640994 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1e52462b-dcfb-4861-8781-113326e0ebd5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.641944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1e52462b-dcfb-4861-8781-113326e0ebd5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.642569 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1e52462b-dcfb-4861-8781-113326e0ebd5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.718558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-80d65c9e-86a3-48ad-a83e-8740fa6f9234 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.728578 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-80d65c9e-86a3-48ad-a83e-8740fa6f9234 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.730286 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-80d65c9e-86a3-48ad-a83e-8740fa6f9234 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.731845 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-80d65c9e-86a3-48ad-a83e-8740fa6f9234 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1751 microversion: 2.20 time: 0.186917 Jul 18 02:38:15.732738 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 221/449] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:15 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:15.757611 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2c233e1e-254f-4f76-8b4a-8e8859dac8bc tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:15.759025 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2c233e1e-254f-4f76-8b4a-8e8859dac8bc tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:15.767325 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2c233e1e-254f-4f76-8b4a-8e8859dac8bc tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.768310 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2c233e1e-254f-4f76-8b4a-8e8859dac8bc tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.771182 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2c233e1e-254f-4f76-8b4a-8e8859dac8bc tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:15.772603 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2c233e1e-254f-4f76-8b4a-8e8859dac8bc tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:15.791719 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1e52462b-dcfb-4861-8781-113326e0ebd5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.801157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1e52462b-dcfb-4861-8781-113326e0ebd5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.174760 Jul 18 02:38:15.812771 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 229/450] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:15 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:15.933463 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-2c233e1e-254f-4f76-8b4a-8e8859dac8bc tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:15.941458 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2c233e1e-254f-4f76-8b4a-8e8859dac8bc tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.194273 Jul 18 02:38:15.942024 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 222/451] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:15 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:16.751517 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-76460d11-c60f-4be9-a0e9-fa4a873fffba tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:16.752864 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-76460d11-c60f-4be9-a0e9-fa4a873fffba tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:16.760937 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-76460d11-c60f-4be9-a0e9-fa4a873fffba tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.768769 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-76460d11-c60f-4be9-a0e9-fa4a873fffba tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.768769 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-76460d11-c60f-4be9-a0e9-fa4a873fffba tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.768769 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-76460d11-c60f-4be9-a0e9-fa4a873fffba tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.819048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d0a6d695-8cb3-4cf6-8268-cbba566071bc tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:16.820878 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d0a6d695-8cb3-4cf6-8268-cbba566071bc tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:16.828927 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d0a6d695-8cb3-4cf6-8268-cbba566071bc tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.829545 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d0a6d695-8cb3-4cf6-8268-cbba566071bc tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.830656 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d0a6d695-8cb3-4cf6-8268-cbba566071bc tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:16.831332 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d0a6d695-8cb3-4cf6-8268-cbba566071bc tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:16.978274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-76460d11-c60f-4be9-a0e9-fa4a873fffba tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:16.987832 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-76460d11-c60f-4be9-a0e9-fa4a873fffba tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:16.989727 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-76460d11-c60f-4be9-a0e9-fa4a873fffba tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:16.991346 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-76460d11-c60f-4be9-a0e9-fa4a873fffba tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1753 microversion: 2.20 time: 0.244033 Jul 18 02:38:16.998470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 230/452] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:16 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1753 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:17.006848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e543d1d5-4976-4206-aacb-15d7f00ecbde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:17.007543 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e543d1d5-4976-4206-aacb-15d7f00ecbde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:17.014556 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e543d1d5-4976-4206-aacb-15d7f00ecbde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.015019 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e543d1d5-4976-4206-aacb-15d7f00ecbde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.015805 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e543d1d5-4976-4206-aacb-15d7f00ecbde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:17.016254 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e543d1d5-4976-4206-aacb-15d7f00ecbde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:17.065904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d0a6d695-8cb3-4cf6-8268-cbba566071bc tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:17.074179 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d0a6d695-8cb3-4cf6-8268-cbba566071bc tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.259183 Jul 18 02:38:17.074753 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 223/453] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:16 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:17.163849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e543d1d5-4976-4206-aacb-15d7f00ecbde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:17.180697 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e543d1d5-4976-4206-aacb-15d7f00ecbde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.180140 Jul 18 02:38:17.181059 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 231/454] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:16 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:18.011715 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-78ecc249-442a-4ebc-a62d-effc440f0208 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:18.013022 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-78ecc249-442a-4ebc-a62d-effc440f0208 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:18.022673 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-78ecc249-442a-4ebc-a62d-effc440f0208 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.023224 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-78ecc249-442a-4ebc-a62d-effc440f0208 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.024517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-78ecc249-442a-4ebc-a62d-effc440f0208 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.024949 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-78ecc249-442a-4ebc-a62d-effc440f0208 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.091054 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7caf760b-c579-42fc-9152-1efc8ecb1f56 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:18.095279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7caf760b-c579-42fc-9152-1efc8ecb1f56 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:18.101848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7caf760b-c579-42fc-9152-1efc8ecb1f56 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.102656 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7caf760b-c579-42fc-9152-1efc8ecb1f56 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.103761 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7caf760b-c579-42fc-9152-1efc8ecb1f56 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.104910 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7caf760b-c579-42fc-9152-1efc8ecb1f56 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.288083 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-78ecc249-442a-4ebc-a62d-effc440f0208 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.300011 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-78ecc249-442a-4ebc-a62d-effc440f0208 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.302012 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-78ecc249-442a-4ebc-a62d-effc440f0208 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.303766 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-78ecc249-442a-4ebc-a62d-effc440f0208 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1753 microversion: 2.20 time: 0.297107 Jul 18 02:38:18.304863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 224/455] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:18 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1753 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:18.310334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7caf760b-c579-42fc-9152-1efc8ecb1f56 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.314562 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-88aed86f-4527-48b6-8836-87c9cde5e6bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:18.314562 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-88aed86f-4527-48b6-8836-87c9cde5e6bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:18.319360 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7caf760b-c579-42fc-9152-1efc8ecb1f56 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.231904 Jul 18 02:38:18.320125 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88aed86f-4527-48b6-8836-87c9cde5e6bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.320898 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88aed86f-4527-48b6-8836-87c9cde5e6bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.321043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 232/456] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:18 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:18.322440 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88aed86f-4527-48b6-8836-87c9cde5e6bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.323107 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88aed86f-4527-48b6-8836-87c9cde5e6bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.470370 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-88aed86f-4527-48b6-8836-87c9cde5e6bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:18.480606 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-88aed86f-4527-48b6-8836-87c9cde5e6bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.173833 Jul 18 02:38:18.481976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 225/457] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:18 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:18.697751 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-eae200cd-ac14-49e8-bd32-8f6ff9a99fc4 req-b811bb9c-d14a-4fc2-aa40-8e60b3a84554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b571193-bc0c-461f-b2ad-e3c66e93ba5d", "name": "network-vif-plugged", "status": "completed", "tag": "a7faca7c-8eb7-4b92-a867-ab4fcf1f065a"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:18.708562 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-eae200cd-ac14-49e8-bd32-8f6ff9a99fc4 req-b811bb9c-d14a-4fc2-aa40-8e60b3a84554 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:18.709089 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-eae200cd-ac14-49e8-bd32-8f6ff9a99fc4 req-b811bb9c-d14a-4fc2-aa40-8e60b3a84554 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:18.724153 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-eae200cd-ac14-49e8-bd32-8f6ff9a99fc4 req-b811bb9c-d14a-4fc2-aa40-8e60b3a84554 service nova] Creating event network-vif-plugged:a7faca7c-8eb7-4b92-a867-ab4fcf1f065a for instance 8b571193-bc0c-461f-b2ad-e3c66e93ba5d on hv-cinder-85001 Jul 18 02:38:18.731177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-eae200cd-ac14-49e8-bd32-8f6ff9a99fc4 req-b811bb9c-d14a-4fc2-aa40-8e60b3a84554 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037826 Jul 18 02:38:18.732135 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 233/458] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:19.345196 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ad01e2ff-18d1-4e72-bed7-0a72bd3d295b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:19.346261 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-dbadaf34-9a9b-4eb8-ae39-59ebf6b98e23 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:19.347575 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-ad01e2ff-18d1-4e72-bed7-0a72bd3d295b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:19.348585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-dbadaf34-9a9b-4eb8-ae39-59ebf6b98e23 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:19.363497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dbadaf34-9a9b-4eb8-ae39-59ebf6b98e23 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:19.364002 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dbadaf34-9a9b-4eb8-ae39-59ebf6b98e23 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:19.364729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dbadaf34-9a9b-4eb8-ae39-59ebf6b98e23 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:19.365169 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dbadaf34-9a9b-4eb8-ae39-59ebf6b98e23 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:19.368349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ad01e2ff-18d1-4e72-bed7-0a72bd3d295b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:19.368808 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ad01e2ff-18d1-4e72-bed7-0a72bd3d295b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:19.369576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ad01e2ff-18d1-4e72-bed7-0a72bd3d295b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:19.370032 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ad01e2ff-18d1-4e72-bed7-0a72bd3d295b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:19.519414 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-dbadaf34-9a9b-4eb8-ae39-59ebf6b98e23 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:19.529414 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-dbadaf34-9a9b-4eb8-ae39-59ebf6b98e23 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:19.531420 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-dbadaf34-9a9b-4eb8-ae39-59ebf6b98e23 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:19.532787 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-dbadaf34-9a9b-4eb8-ae39-59ebf6b98e23 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.212915 Jul 18 02:38:19.532990 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ad01e2ff-18d1-4e72-bed7-0a72bd3d295b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:19.543938 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ad01e2ff-18d1-4e72-bed7-0a72bd3d295b tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.203625 Jul 18 02:38:19.544524 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 226/459] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:19 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:19.545137 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 234/460] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:19 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:19.549221 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f4fbd415-d5de-4142-96e4-0a79fbcd20cd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:19.550116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f4fbd415-d5de-4142-96e4-0a79fbcd20cd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:19.560029 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f4fbd415-d5de-4142-96e4-0a79fbcd20cd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:19.560557 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f4fbd415-d5de-4142-96e4-0a79fbcd20cd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:19.561417 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f4fbd415-d5de-4142-96e4-0a79fbcd20cd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:19.561947 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f4fbd415-d5de-4142-96e4-0a79fbcd20cd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:19.720775 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f4fbd415-d5de-4142-96e4-0a79fbcd20cd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:19.729263 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f4fbd415-d5de-4142-96e4-0a79fbcd20cd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.183619 Jul 18 02:38:19.730033 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 227/461] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:19 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:20.553967 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-05dd1398-b62c-4937-9ef7-355b49b100d8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:20.554907 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-05dd1398-b62c-4937-9ef7-355b49b100d8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:20.564198 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c47bbf6d-5c0c-4f23-9b1b-10a5f260d639 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:20.565902 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c47bbf6d-5c0c-4f23-9b1b-10a5f260d639 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:20.567005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-05dd1398-b62c-4937-9ef7-355b49b100d8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.567713 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-05dd1398-b62c-4937-9ef7-355b49b100d8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.568875 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-05dd1398-b62c-4937-9ef7-355b49b100d8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.569576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-05dd1398-b62c-4937-9ef7-355b49b100d8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.580029 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c47bbf6d-5c0c-4f23-9b1b-10a5f260d639 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.580662 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c47bbf6d-5c0c-4f23-9b1b-10a5f260d639 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.581350 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c47bbf6d-5c0c-4f23-9b1b-10a5f260d639 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.581812 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c47bbf6d-5c0c-4f23-9b1b-10a5f260d639 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.604675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:20.751468 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-05dd1398-b62c-4937-9ef7-355b49b100d8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.765555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-05dd1398-b62c-4937-9ef7-355b49b100d8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.767525 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-05dd1398-b62c-4937-9ef7-355b49b100d8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.768969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-05dd1398-b62c-4937-9ef7-355b49b100d8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.220929 Jul 18 02:38:20.782579 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 235/462] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:20 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:20.790272 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-608119674", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-530523020", "security_groups": [{"name": "tempest-secgroup-smoke-1668344787"}], "block_device_mapping_v2": [{"uuid": "8e991827-7b88-455b-af25-cf5a45d157f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "40df86f1-859f-4d28-af05-d94fe8d1d2ea"}]}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:20.813415 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c47bbf6d-5c0c-4f23-9b1b-10a5f260d639 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:20.824662 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c47bbf6d-5c0c-4f23-9b1b-10a5f260d639 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1315 microversion: 2.1 time: 0.264062 Jul 18 02:38:20.834740 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 228/463] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:20 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:20.839529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-15af9209-dc99-45df-89b7-a3dbf54c2529 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:20.840192 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-15af9209-dc99-45df-89b7-a3dbf54c2529 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:20.860584 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-15af9209-dc99-45df-89b7-a3dbf54c2529 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.861679 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-15af9209-dc99-45df-89b7-a3dbf54c2529 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:20.862053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-15af9209-dc99-45df-89b7-a3dbf54c2529 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:20.862803 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-15af9209-dc99-45df-89b7-a3dbf54c2529 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:21.147815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-15af9209-dc99-45df-89b7-a3dbf54c2529 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:21.156265 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-15af9209-dc99-45df-89b7-a3dbf54c2529 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.328885 Jul 18 02:38:21.161004 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 229/464] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:20 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:21.168983 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-735f2cfc-91d1-441b-bcec-8ad0b9a66677 req-c7cc15e5-926a-4e31-baf6-bf7663db8087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202ad2e8-7648-4965-afb6-736cb94b74ac", "name": "network-vif-plugged", "status": "completed", "tag": "b201d32b-4faf-4b5d-b867-467d2b9bcc9a"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:21.179638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-735f2cfc-91d1-441b-bcec-8ad0b9a66677 req-c7cc15e5-926a-4e31-baf6-bf7663db8087 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:21.181961 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-735f2cfc-91d1-441b-bcec-8ad0b9a66677 req-c7cc15e5-926a-4e31-baf6-bf7663db8087 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:21.223810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.network.neutron [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] validate_networks() for [('40df86f1-859f-4d28-af05-d94fe8d1d2ea', None, None, None, None, None)] {{(pid=124890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:38:21.231332 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-735f2cfc-91d1-441b-bcec-8ad0b9a66677 req-c7cc15e5-926a-4e31-baf6-bf7663db8087 service nova] Creating event network-vif-plugged:b201d32b-4faf-4b5d-b867-467d2b9bcc9a for instance 202ad2e8-7648-4965-afb6-736cb94b74ac on hv-cinder-85001 Jul 18 02:38:21.240607 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-735f2cfc-91d1-441b-bcec-8ad0b9a66677 req-c7cc15e5-926a-4e31-baf6-bf7663db8087 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078182 Jul 18 02:38:21.241885 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 230/465] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:21.656688 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Flavor limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:38:21.656688 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Image limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:38:21.656688 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Flavor pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:38:21.656688 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Image pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:38:21.656688 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:38:21.665398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:21.666338 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:21.667384 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:21.667824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:21.688831 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Getting quotas for project 807f88779cf842f3bbe09615d470f44c. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:38:21.693672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Getting quotas for user 41a452eca3af46b09f56a80fa8652247 and project 807f88779cf842f3bbe09615d470f44c. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:38:21.765349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Going to run 1 instances... {{(pid=124890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:38:21.767686 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e991827-7b88-455b-af25-cf5a45d157f2',volume_size=None,volume_type=None)] {{(pid=124890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:38:21.790521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-78c8357e-bcc3-44e2-a8ba-dc72e18aeaff tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:21.792170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-78c8357e-bcc3-44e2-a8ba-dc72e18aeaff tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:21.799917 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-78c8357e-bcc3-44e2-a8ba-dc72e18aeaff tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:21.805808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-78c8357e-bcc3-44e2-a8ba-dc72e18aeaff tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:21.808412 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-78c8357e-bcc3-44e2-a8ba-dc72e18aeaff tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:21.810290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-78c8357e-bcc3-44e2-a8ba-dc72e18aeaff tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.113737 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-78c8357e-bcc3-44e2-a8ba-dc72e18aeaff tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:22.125258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-78c8357e-bcc3-44e2-a8ba-dc72e18aeaff tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:22.142910 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-78c8357e-bcc3-44e2-a8ba-dc72e18aeaff tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:22.142910 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-78c8357e-bcc3-44e2-a8ba-dc72e18aeaff tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.346409 Jul 18 02:38:22.142910 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 231/466] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:21 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:22.146816 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a52a405c-f86b-47d6-bc48-7f0b0162c27e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:22.147593 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a52a405c-f86b-47d6-bc48-7f0b0162c27e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:22.149714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:22.165111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a52a405c-f86b-47d6-bc48-7f0b0162c27e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.166223 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a52a405c-f86b-47d6-bc48-7f0b0162c27e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.167249 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a52a405c-f86b-47d6-bc48-7f0b0162c27e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.178805 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a52a405c-f86b-47d6-bc48-7f0b0162c27e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.187495 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:22.486323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-085b014b-a3d3-46a7-b214-1288216dc2ef tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.701477 Jul 18 02:38:22.492386 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 236/467] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:38:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:38:22.497638 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-262dbc66-707a-40c3-ae37-ddc424270ca0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:22.498284 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-262dbc66-707a-40c3-ae37-ddc424270ca0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:22.504794 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-262dbc66-707a-40c3-ae37-ddc424270ca0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.505396 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-262dbc66-707a-40c3-ae37-ddc424270ca0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.506375 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-262dbc66-707a-40c3-ae37-ddc424270ca0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.506819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-262dbc66-707a-40c3-ae37-ddc424270ca0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.598350 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a52a405c-f86b-47d6-bc48-7f0b0162c27e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:22.608018 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a52a405c-f86b-47d6-bc48-7f0b0162c27e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1465 microversion: 2.1 time: 0.474411 Jul 18 02:38:22.623306 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 232/468] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:22 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1465 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:22.626547 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4fdb5900-2b9f-4620-a7fa-14d6a3244604 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:22.626991 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4fdb5900-2b9f-4620-a7fa-14d6a3244604 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:22.700497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4fdb5900-2b9f-4620-a7fa-14d6a3244604 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:22.712538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4fdb5900-2b9f-4620-a7fa-14d6a3244604 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1093 microversion: 2.1 time: 0.085277 Jul 18 02:38:22.712538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 233/469] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:22 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:22.725105 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-964a18be-12ba-44af-81a6-ba503522d941 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:22.725844 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-964a18be-12ba-44af-81a6-ba503522d941 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:22.733443 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-964a18be-12ba-44af-81a6-ba503522d941 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.733897 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-964a18be-12ba-44af-81a6-ba503522d941 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.734706 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-964a18be-12ba-44af-81a6-ba503522d941 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:22.735675 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-964a18be-12ba-44af-81a6-ba503522d941 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:22.759884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-262dbc66-707a-40c3-ae37-ddc424270ca0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:22.764912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-964a18be-12ba-44af-81a6-ba503522d941 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:38:22.770287 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-262dbc66-707a-40c3-ae37-ddc424270ca0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.274899 Jul 18 02:38:22.770287 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 237/470] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:22 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:23.101818 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-964a18be-12ba-44af-81a6-ba503522d941 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 204 len: 0 microversion: 2.1 time: 0.379736 Jul 18 02:38:23.107825 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 234/471] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:38:22 2022] DELETE /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:38:23.112092 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9ab001aa-24c6-4aa7-b893-fbf174fd73ad tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:23.112788 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9ab001aa-24c6-4aa7-b893-fbf174fd73ad tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:23.119975 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9ab001aa-24c6-4aa7-b893-fbf174fd73ad tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:23.120424 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9ab001aa-24c6-4aa7-b893-fbf174fd73ad tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:23.121354 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9ab001aa-24c6-4aa7-b893-fbf174fd73ad tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:23.121799 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9ab001aa-24c6-4aa7-b893-fbf174fd73ad tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:23.152827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e81fae3c-e7cb-4726-a209-ba84976bbb83 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:23.153508 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e81fae3c-e7cb-4726-a209-ba84976bbb83 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:23.159892 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e81fae3c-e7cb-4726-a209-ba84976bbb83 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:23.160351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e81fae3c-e7cb-4726-a209-ba84976bbb83 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:23.161131 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e81fae3c-e7cb-4726-a209-ba84976bbb83 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:23.161573 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e81fae3c-e7cb-4726-a209-ba84976bbb83 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:23.316245 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9ab001aa-24c6-4aa7-b893-fbf174fd73ad tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:23.327773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9ab001aa-24c6-4aa7-b893-fbf174fd73ad tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1471 microversion: 2.1 time: 0.219599 Jul 18 02:38:23.328792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 238/472] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:23 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:23.387247 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e81fae3c-e7cb-4726-a209-ba84976bbb83 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:23.403496 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e81fae3c-e7cb-4726-a209-ba84976bbb83 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:23.405012 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e81fae3c-e7cb-4726-a209-ba84976bbb83 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:23.406218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e81fae3c-e7cb-4726-a209-ba84976bbb83 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.260224 Jul 18 02:38:23.406986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 235/473] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:23 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:23.725862 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4fa1bb7f-81c4-4b5c-951f-4f969032fb4e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:23.733538 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4fa1bb7f-81c4-4b5c-951f-4f969032fb4e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:23.789082 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1870df11-c378-490a-acd7-7542e83cefb4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:23.790271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1870df11-c378-490a-acd7-7542e83cefb4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:23.793942 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4fa1bb7f-81c4-4b5c-951f-4f969032fb4e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:23.796959 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1870df11-c378-490a-acd7-7542e83cefb4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:23.797503 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1870df11-c378-490a-acd7-7542e83cefb4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:23.798596 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1870df11-c378-490a-acd7-7542e83cefb4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:23.799037 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1870df11-c378-490a-acd7-7542e83cefb4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:23.806079 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4fa1bb7f-81c4-4b5c-951f-4f969032fb4e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1093 microversion: 2.1 time: 0.084674 Jul 18 02:38:23.817496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 239/474] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:23 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1093 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:23.968108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1870df11-c378-490a-acd7-7542e83cefb4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:23.978539 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1870df11-c378-490a-acd7-7542e83cefb4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.192982 Jul 18 02:38:23.988325 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 236/475] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:23 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:24.346022 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b0135be7-6cc8-4171-8a48-f38ffa5479e8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:24.346662 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b0135be7-6cc8-4171-8a48-f38ffa5479e8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:24.354272 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b0135be7-6cc8-4171-8a48-f38ffa5479e8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.354723 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b0135be7-6cc8-4171-8a48-f38ffa5479e8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.355663 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b0135be7-6cc8-4171-8a48-f38ffa5479e8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.356106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b0135be7-6cc8-4171-8a48-f38ffa5479e8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.425030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-faaffbe2-358c-4ef8-b05e-5469d042c46f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:24.425669 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-faaffbe2-358c-4ef8-b05e-5469d042c46f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:24.437762 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-faaffbe2-358c-4ef8-b05e-5469d042c46f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.438490 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-faaffbe2-358c-4ef8-b05e-5469d042c46f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.439730 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-faaffbe2-358c-4ef8-b05e-5469d042c46f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.440492 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-faaffbe2-358c-4ef8-b05e-5469d042c46f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.543021 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b0135be7-6cc8-4171-8a48-f38ffa5479e8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.551616 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b0135be7-6cc8-4171-8a48-f38ffa5479e8 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1471 microversion: 2.1 time: 0.209555 Jul 18 02:38:24.553370 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 240/476] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:24 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:24.621064 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-faaffbe2-358c-4ef8-b05e-5469d042c46f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.629528 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-faaffbe2-358c-4ef8-b05e-5469d042c46f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.631081 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-faaffbe2-358c-4ef8-b05e-5469d042c46f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.632239 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-faaffbe2-358c-4ef8-b05e-5469d042c46f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.211238 Jul 18 02:38:24.632802 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 237/477] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:24 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:24.824634 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-04b15e75-7448-4d79-b01f-76f1efdef23a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:24.825247 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-04b15e75-7448-4d79-b01f-76f1efdef23a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:24.835089 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04b15e75-7448-4d79-b01f-76f1efdef23a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.835560 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04b15e75-7448-4d79-b01f-76f1efdef23a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.836406 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04b15e75-7448-4d79-b01f-76f1efdef23a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:24.836964 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04b15e75-7448-4d79-b01f-76f1efdef23a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:24.903491 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-04b15e75-7448-4d79-b01f-76f1efdef23a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:24.911483 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-04b15e75-7448-4d79-b01f-76f1efdef23a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1143 microversion: 2.1 time: 0.091435 Jul 18 02:38:24.912199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 241/478] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:24 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:25.007218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1095019b-ef96-48e0-9ff9-086c2eabc0d9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:25.007822 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1095019b-ef96-48e0-9ff9-086c2eabc0d9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:25.021661 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1095019b-ef96-48e0-9ff9-086c2eabc0d9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.022128 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1095019b-ef96-48e0-9ff9-086c2eabc0d9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.022915 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1095019b-ef96-48e0-9ff9-086c2eabc0d9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.023356 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1095019b-ef96-48e0-9ff9-086c2eabc0d9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.170294 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1095019b-ef96-48e0-9ff9-086c2eabc0d9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:25.178980 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1095019b-ef96-48e0-9ff9-086c2eabc0d9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1370 microversion: 2.1 time: 0.179536 Jul 18 02:38:25.179970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 238/479] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:24 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:25.572206 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6710f54e-194c-449e-9176-512de7decc2e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:25.573022 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6710f54e-194c-449e-9176-512de7decc2e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:25.579557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6710f54e-194c-449e-9176-512de7decc2e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.579998 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6710f54e-194c-449e-9176-512de7decc2e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.580748 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6710f54e-194c-449e-9176-512de7decc2e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.581176 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6710f54e-194c-449e-9176-512de7decc2e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.651389 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-10f4719b-4c41-4a80-9489-2f33cd921634 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:25.652041 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-10f4719b-4c41-4a80-9489-2f33cd921634 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:25.659669 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-10f4719b-4c41-4a80-9489-2f33cd921634 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.660118 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-10f4719b-4c41-4a80-9489-2f33cd921634 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.660981 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-10f4719b-4c41-4a80-9489-2f33cd921634 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.661415 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-10f4719b-4c41-4a80-9489-2f33cd921634 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.725284 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6710f54e-194c-449e-9176-512de7decc2e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:25.733208 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6710f54e-194c-449e-9176-512de7decc2e tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1471 microversion: 2.1 time: 0.165864 Jul 18 02:38:25.733795 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 242/480] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:25 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:25.800784 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-10f4719b-4c41-4a80-9489-2f33cd921634 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:25.810270 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-10f4719b-4c41-4a80-9489-2f33cd921634 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:25.811843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-10f4719b-4c41-4a80-9489-2f33cd921634 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:25.812961 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-10f4719b-4c41-4a80-9489-2f33cd921634 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.165987 Jul 18 02:38:25.813713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 239/481] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:25 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:25.928761 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-df813175-c699-4728-95c9-1b4931fd9ee1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:25.929378 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-df813175-c699-4728-95c9-1b4931fd9ee1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:25.936318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-df813175-c699-4728-95c9-1b4931fd9ee1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.936771 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-df813175-c699-4728-95c9-1b4931fd9ee1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:25.937539 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-df813175-c699-4728-95c9-1b4931fd9ee1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:25.937978 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-df813175-c699-4728-95c9-1b4931fd9ee1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:26.000608 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-df813175-c699-4728-95c9-1b4931fd9ee1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:26.008193 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-df813175-c699-4728-95c9-1b4931fd9ee1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1143 microversion: 2.1 time: 0.083252 Jul 18 02:38:26.008741 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 243/482] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:25 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:26.196967 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8c9d73e7-6c6f-4b02-9a19-b6df4f3eaa67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:26.197609 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8c9d73e7-6c6f-4b02-9a19-b6df4f3eaa67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:26.204081 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8c9d73e7-6c6f-4b02-9a19-b6df4f3eaa67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:26.204542 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8c9d73e7-6c6f-4b02-9a19-b6df4f3eaa67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:26.205308 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8c9d73e7-6c6f-4b02-9a19-b6df4f3eaa67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:26.205743 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8c9d73e7-6c6f-4b02-9a19-b6df4f3eaa67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:26.333511 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8c9d73e7-6c6f-4b02-9a19-b6df4f3eaa67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:26.343247 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8c9d73e7-6c6f-4b02-9a19-b6df4f3eaa67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1563 microversion: 2.1 time: 0.150111 Jul 18 02:38:26.343906 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 240/483] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:26 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:26.360185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-65301c4c-4112-49ad-b5b3-9f679ef2e8b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:26.360686 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-65301c4c-4112-49ad-b5b3-9f679ef2e8b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:26.366837 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-65301c4c-4112-49ad-b5b3-9f679ef2e8b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:26.367296 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-65301c4c-4112-49ad-b5b3-9f679ef2e8b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:26.368066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-65301c4c-4112-49ad-b5b3-9f679ef2e8b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:26.368541 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-65301c4c-4112-49ad-b5b3-9f679ef2e8b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:26.443662 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-65301c4c-4112-49ad-b5b3-9f679ef2e8b1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087422 Jul 18 02:38:26.444286 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 244/484] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 18 02:38:26 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:26.750441 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-882e7ea5-b824-42b0-8867-01e351de9c19 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:26.755713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-882e7ea5-b824-42b0-8867-01e351de9c19 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:26.758594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-882e7ea5-b824-42b0-8867-01e351de9c19 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:26.759694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-882e7ea5-b824-42b0-8867-01e351de9c19 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:26.760763 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-882e7ea5-b824-42b0-8867-01e351de9c19 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:26.761299 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-882e7ea5-b824-42b0-8867-01e351de9c19 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:26.835146 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e90ba5bd-ce9c-4710-b0d2-5516ffe0ecd9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:26.835146 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e90ba5bd-ce9c-4710-b0d2-5516ffe0ecd9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:26.839466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e90ba5bd-ce9c-4710-b0d2-5516ffe0ecd9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:26.840184 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e90ba5bd-ce9c-4710-b0d2-5516ffe0ecd9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:26.841191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e90ba5bd-ce9c-4710-b0d2-5516ffe0ecd9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:26.841848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e90ba5bd-ce9c-4710-b0d2-5516ffe0ecd9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.073179 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e90ba5bd-ce9c-4710-b0d2-5516ffe0ecd9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:27.084572 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e90ba5bd-ce9c-4710-b0d2-5516ffe0ecd9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:27.086707 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e90ba5bd-ce9c-4710-b0d2-5516ffe0ecd9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:27.088239 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e90ba5bd-ce9c-4710-b0d2-5516ffe0ecd9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.260768 Jul 18 02:38:27.089379 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 245/485] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:26 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:27.094828 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fd8ca423-f6c9-4549-8747-24e3d61d93f1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:27.095920 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fd8ca423-f6c9-4549-8747-24e3d61d93f1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:27.106945 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fd8ca423-f6c9-4549-8747-24e3d61d93f1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:27.107419 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fd8ca423-f6c9-4549-8747-24e3d61d93f1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.108274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fd8ca423-f6c9-4549-8747-24e3d61d93f1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:27.109010 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fd8ca423-f6c9-4549-8747-24e3d61d93f1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.210292 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-882e7ea5-b824-42b0-8867-01e351de9c19 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:27.220318 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-882e7ea5-b824-42b0-8867-01e351de9c19 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1471 microversion: 2.1 time: 0.471731 Jul 18 02:38:27.225437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fd8ca423-f6c9-4549-8747-24e3d61d93f1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:27.230579 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 241/486] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:26 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:27.235046 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fd8ca423-f6c9-4549-8747-24e3d61d93f1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1191 microversion: 2.1 time: 0.143900 Jul 18 02:38:27.254576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 246/487] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:27 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1191 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:27.707148 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-ecd05bf3-0ccf-4f6b-b286-10c5e92302da req-0364e6eb-6951-4bfa-9e2c-2e6d5ac6678e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b571193-bc0c-461f-b2ad-e3c66e93ba5d", "name": "network-vif-deleted", "tag": "a7faca7c-8eb7-4b92-a867-ab4fcf1f065a"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:27.725910 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-ecd05bf3-0ccf-4f6b-b286-10c5e92302da req-0364e6eb-6951-4bfa-9e2c-2e6d5ac6678e service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:27.726390 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-ecd05bf3-0ccf-4f6b-b286-10c5e92302da req-0364e6eb-6951-4bfa-9e2c-2e6d5ac6678e service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.742816 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-ecd05bf3-0ccf-4f6b-b286-10c5e92302da req-0364e6eb-6951-4bfa-9e2c-2e6d5ac6678e service nova] Creating event network-vif-deleted:a7faca7c-8eb7-4b92-a867-ab4fcf1f065a for instance 8b571193-bc0c-461f-b2ad-e3c66e93ba5d on hv-cinder-85001 Jul 18 02:38:27.753724 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-ecd05bf3-0ccf-4f6b-b286-10c5e92302da req-0364e6eb-6951-4bfa-9e2c-2e6d5ac6678e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050095 Jul 18 02:38:27.754438 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 242/488] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:27.956840 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-f29b4f60-4f44-40b5-8cda-76fe394bef59 req-e5191de7-9838-400c-99ac-ec20a3b0e7fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202ad2e8-7648-4965-afb6-736cb94b74ac", "tag": "b201d32b-4faf-4b5d-b867-467d2b9bcc9a"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:27.967550 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-f29b4f60-4f44-40b5-8cda-76fe394bef59 req-e5191de7-9838-400c-99ac-ec20a3b0e7fc service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:27.967992 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-f29b4f60-4f44-40b5-8cda-76fe394bef59 req-e5191de7-9838-400c-99ac-ec20a3b0e7fc service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:27.980200 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-f29b4f60-4f44-40b5-8cda-76fe394bef59 req-e5191de7-9838-400c-99ac-ec20a3b0e7fc service nova] Creating event network-changed:b201d32b-4faf-4b5d-b867-467d2b9bcc9a for instance 202ad2e8-7648-4965-afb6-736cb94b74ac on hv-cinder-85001 Jul 18 02:38:27.985194 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-f29b4f60-4f44-40b5-8cda-76fe394bef59 req-e5191de7-9838-400c-99ac-ec20a3b0e7fc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032103 Jul 18 02:38:27.985946 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 247/489] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:28.108705 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3b20285a-d086-4b98-968d-c3cee0fd3472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:28.109411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3b20285a-d086-4b98-968d-c3cee0fd3472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:28.126194 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3b20285a-d086-4b98-968d-c3cee0fd3472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.126679 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3b20285a-d086-4b98-968d-c3cee0fd3472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.127480 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3b20285a-d086-4b98-968d-c3cee0fd3472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.127928 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3b20285a-d086-4b98-968d-c3cee0fd3472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.240588 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a8af0fda-7a6f-4af6-9ac8-1bb86fe77e97 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:28.241532 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a8af0fda-7a6f-4af6-9ac8-1bb86fe77e97 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:28.252338 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a8af0fda-7a6f-4af6-9ac8-1bb86fe77e97 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.253765 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a8af0fda-7a6f-4af6-9ac8-1bb86fe77e97 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.255536 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a8af0fda-7a6f-4af6-9ac8-1bb86fe77e97 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.256231 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a8af0fda-7a6f-4af6-9ac8-1bb86fe77e97 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.299431 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3b20285a-d086-4b98-968d-c3cee0fd3472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.311786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3b20285a-d086-4b98-968d-c3cee0fd3472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.313854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3b20285a-d086-4b98-968d-c3cee0fd3472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.316429 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3b20285a-d086-4b98-968d-c3cee0fd3472 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.212278 Jul 18 02:38:28.327056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 243/490] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:28 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:28.330177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a8af0fda-7a6f-4af6-9ac8-1bb86fe77e97 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.333953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6ce1c973-6ecf-4052-b014-62aaad24f9c6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:28.334605 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6ce1c973-6ecf-4052-b014-62aaad24f9c6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:28.338734 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a8af0fda-7a6f-4af6-9ac8-1bb86fe77e97 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1429 microversion: 2.1 time: 0.102639 Jul 18 02:38:28.339930 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 248/491] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:28 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1429 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:28.353416 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ce1c973-6ecf-4052-b014-62aaad24f9c6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.354545 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ce1c973-6ecf-4052-b014-62aaad24f9c6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.355342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ce1c973-6ecf-4052-b014-62aaad24f9c6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:28.355777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ce1c973-6ecf-4052-b014-62aaad24f9c6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:28.454580 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6ce1c973-6ecf-4052-b014-62aaad24f9c6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:28.460661 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6ce1c973-6ecf-4052-b014-62aaad24f9c6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1191 microversion: 2.1 time: 0.141587 Jul 18 02:38:28.463061 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 244/492] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:28 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1191 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:29.340150 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-eac794db-67e2-4134-95cf-4b4231d2c55a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:29.342156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-eac794db-67e2-4134-95cf-4b4231d2c55a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:29.358413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eac794db-67e2-4134-95cf-4b4231d2c55a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:29.358413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eac794db-67e2-4134-95cf-4b4231d2c55a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:29.358413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eac794db-67e2-4134-95cf-4b4231d2c55a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:29.358413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eac794db-67e2-4134-95cf-4b4231d2c55a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:29.358919 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0acf73e5-cd62-448e-8c64-9376bd279c48 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:29.358919 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0acf73e5-cd62-448e-8c64-9376bd279c48 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:29.367513 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0acf73e5-cd62-448e-8c64-9376bd279c48 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:29.367965 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0acf73e5-cd62-448e-8c64-9376bd279c48 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:29.368780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0acf73e5-cd62-448e-8c64-9376bd279c48 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:29.369406 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0acf73e5-cd62-448e-8c64-9376bd279c48 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:29.440009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0acf73e5-cd62-448e-8c64-9376bd279c48 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:29.448567 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0acf73e5-cd62-448e-8c64-9376bd279c48 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1429 microversion: 2.1 time: 0.095959 Jul 18 02:38:29.449361 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 245/493] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:29 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:29.480199 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0d67ca49-26b6-446f-a5fc-76a2f366dd8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:29.503207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0d67ca49-26b6-446f-a5fc-76a2f366dd8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:29.503207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0d67ca49-26b6-446f-a5fc-76a2f366dd8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:29.503207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0d67ca49-26b6-446f-a5fc-76a2f366dd8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:29.503207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0d67ca49-26b6-446f-a5fc-76a2f366dd8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:29.503613 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0d67ca49-26b6-446f-a5fc-76a2f366dd8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:29.511735 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-eac794db-67e2-4134-95cf-4b4231d2c55a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:29.522151 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-eac794db-67e2-4134-95cf-4b4231d2c55a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:29.523676 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-eac794db-67e2-4134-95cf-4b4231d2c55a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:29.525349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-eac794db-67e2-4134-95cf-4b4231d2c55a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.192898 Jul 18 02:38:29.526482 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 249/494] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:29 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:29.556751 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0d67ca49-26b6-446f-a5fc-76a2f366dd8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:29.564853 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0d67ca49-26b6-446f-a5fc-76a2f366dd8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1191 microversion: 2.1 time: 0.089494 Jul 18 02:38:29.565455 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 246/495] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:29 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:30.469848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3c083319-00b5-4fb7-aab6-bf2dc86a87ac tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:30.471459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3c083319-00b5-4fb7-aab6-bf2dc86a87ac tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:30.482020 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c083319-00b5-4fb7-aab6-bf2dc86a87ac tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.486274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c083319-00b5-4fb7-aab6-bf2dc86a87ac tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.486274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c083319-00b5-4fb7-aab6-bf2dc86a87ac tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.486274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c083319-00b5-4fb7-aab6-bf2dc86a87ac tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.555004 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3c083319-00b5-4fb7-aab6-bf2dc86a87ac tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:30.562969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3c083319-00b5-4fb7-aab6-bf2dc86a87ac tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1300 microversion: 2.1 time: 0.099096 Jul 18 02:38:30.563667 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 250/496] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:30 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:30.589408 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e7dc5331-afd0-4af4-a903-cacf8912ca63 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:30.590123 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e7dc5331-afd0-4af4-a903-cacf8912ca63 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:30.592398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7d3755b9-77f0-4133-9733-a9f066e77aa9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:30.593016 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7d3755b9-77f0-4133-9733-a9f066e77aa9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:30.602483 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7d3755b9-77f0-4133-9733-a9f066e77aa9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.602483 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7d3755b9-77f0-4133-9733-a9f066e77aa9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.602483 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7d3755b9-77f0-4133-9733-a9f066e77aa9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.605762 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e7dc5331-afd0-4af4-a903-cacf8912ca63 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.606751 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e7dc5331-afd0-4af4-a903-cacf8912ca63 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.607823 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e7dc5331-afd0-4af4-a903-cacf8912ca63 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:30.609014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e7dc5331-afd0-4af4-a903-cacf8912ca63 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.614486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7d3755b9-77f0-4133-9733-a9f066e77aa9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:30.702746 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e7dc5331-afd0-4af4-a903-cacf8912ca63 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:30.713814 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e7dc5331-afd0-4af4-a903-cacf8912ca63 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1191 microversion: 2.1 time: 0.128320 Jul 18 02:38:30.722525 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 247/497] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:30 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1191 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:30.789485 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7d3755b9-77f0-4133-9733-a9f066e77aa9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:30.799086 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7d3755b9-77f0-4133-9733-a9f066e77aa9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:30.806809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7d3755b9-77f0-4133-9733-a9f066e77aa9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:30.806809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7d3755b9-77f0-4133-9733-a9f066e77aa9 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.214309 Jul 18 02:38:30.806809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 251/498] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:30 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:31.580148 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d256d63d-cc13-4bb0-84a4-594b912b1ec9 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:31.580764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d256d63d-cc13-4bb0-84a4-594b912b1ec9 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:31.587021 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d256d63d-cc13-4bb0-84a4-594b912b1ec9 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.587477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d256d63d-cc13-4bb0-84a4-594b912b1ec9 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.588262 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d256d63d-cc13-4bb0-84a4-594b912b1ec9 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.588698 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d256d63d-cc13-4bb0-84a4-594b912b1ec9 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.657733 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d256d63d-cc13-4bb0-84a4-594b912b1ec9 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:31.661146 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:31.669524 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d256d63d-cc13-4bb0-84a4-594b912b1ec9 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1300 microversion: 2.1 time: 0.093143 Jul 18 02:38:31.670174 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 248/499] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:31 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:31.731521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bc8f55de-f652-4b6a-b84d-8288ce445a60 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:31.732218 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bc8f55de-f652-4b6a-b84d-8288ce445a60 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:31.734944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:31.740843 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bc8f55de-f652-4b6a-b84d-8288ce445a60 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.741303 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bc8f55de-f652-4b6a-b84d-8288ce445a60 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.742058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bc8f55de-f652-4b6a-b84d-8288ce445a60 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.742515 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bc8f55de-f652-4b6a-b84d-8288ce445a60 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.808661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bc8f55de-f652-4b6a-b84d-8288ce445a60 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:31.817421 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bc8f55de-f652-4b6a-b84d-8288ce445a60 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1191 microversion: 2.1 time: 0.090052 Jul 18 02:38:31.817914 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 252/500] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:31 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:31.820923 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f3dfee56-e733-42c3-a477-c26b988487da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:31.821466 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f3dfee56-e733-42c3-a477-c26b988487da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:31.830873 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f3dfee56-e733-42c3-a477-c26b988487da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.844894 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f3dfee56-e733-42c3-a477-c26b988487da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.844894 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f3dfee56-e733-42c3-a477-c26b988487da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:31.844894 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f3dfee56-e733-42c3-a477-c26b988487da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:31.982995 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f3dfee56-e733-42c3-a477-c26b988487da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:31.992702 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f3dfee56-e733-42c3-a477-c26b988487da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:31.995584 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f3dfee56-e733-42c3-a477-c26b988487da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:31.996849 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f3dfee56-e733-42c3-a477-c26b988487da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.180092 Jul 18 02:38:32.002128 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 249/501] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:31 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:32.688377 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8831bb93-fad9-409c-a101-e381ff2d77f5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:32.689162 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8831bb93-fad9-409c-a101-e381ff2d77f5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:32.696759 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8831bb93-fad9-409c-a101-e381ff2d77f5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:32.697637 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8831bb93-fad9-409c-a101-e381ff2d77f5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:32.698573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8831bb93-fad9-409c-a101-e381ff2d77f5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:32.699126 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8831bb93-fad9-409c-a101-e381ff2d77f5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:32.777208 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8831bb93-fad9-409c-a101-e381ff2d77f5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:32.791590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8831bb93-fad9-409c-a101-e381ff2d77f5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1300 microversion: 2.1 time: 0.107667 Jul 18 02:38:32.793142 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 253/502] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:32 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:32.835558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8a1fc803-4345-4188-b09a-78faac71511f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:32.836197 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8a1fc803-4345-4188-b09a-78faac71511f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:32.848988 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:32.850669 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a1fc803-4345-4188-b09a-78faac71511f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:32.851123 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a1fc803-4345-4188-b09a-78faac71511f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:32.851910 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a1fc803-4345-4188-b09a-78faac71511f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:32.852346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a1fc803-4345-4188-b09a-78faac71511f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:32.936788 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8a1fc803-4345-4188-b09a-78faac71511f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:32.944534 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8a1fc803-4345-4188-b09a-78faac71511f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1191 microversion: 2.1 time: 0.113539 Jul 18 02:38:32.945104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 250/503] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:32 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1191 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:33.017232 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-da912377-6d4d-48e8-a5a2-6b3770bcb477 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:33.017843 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-da912377-6d4d-48e8-a5a2-6b3770bcb477 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:33.024034 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da912377-6d4d-48e8-a5a2-6b3770bcb477 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.024479 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da912377-6d4d-48e8-a5a2-6b3770bcb477 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.025415 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da912377-6d4d-48e8-a5a2-6b3770bcb477 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.025817 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da912377-6d4d-48e8-a5a2-6b3770bcb477 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.043900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:33.164516 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-da912377-6d4d-48e8-a5a2-6b3770bcb477 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.175678 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-da912377-6d4d-48e8-a5a2-6b3770bcb477 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.177764 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-da912377-6d4d-48e8-a5a2-6b3770bcb477 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.179448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-da912377-6d4d-48e8-a5a2-6b3770bcb477 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.167446 Jul 18 02:38:33.192387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 254/504] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:33 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:33.811740 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-99644c37-4205-40b2-9616-83d7d921bb2f tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:33.812354 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-99644c37-4205-40b2-9616-83d7d921bb2f tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:33.821427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99644c37-4205-40b2-9616-83d7d921bb2f tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.832260 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99644c37-4205-40b2-9616-83d7d921bb2f tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.832260 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99644c37-4205-40b2-9616-83d7d921bb2f tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.832260 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99644c37-4205-40b2-9616-83d7d921bb2f tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.902482 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-99644c37-4205-40b2-9616-83d7d921bb2f tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:33.911214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-99644c37-4205-40b2-9616-83d7d921bb2f tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1300 microversion: 2.1 time: 0.104485 Jul 18 02:38:33.911800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 251/505] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:33 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:33.964862 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fc4dd663-2ea4-4c5b-b2de-3e7a295e549e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:33.965437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fc4dd663-2ea4-4c5b-b2de-3e7a295e549e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:33.968252 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=8 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:33.982880 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fc4dd663-2ea4-4c5b-b2de-3e7a295e549e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.983331 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fc4dd663-2ea4-4c5b-b2de-3e7a295e549e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:33.984112 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fc4dd663-2ea4-4c5b-b2de-3e7a295e549e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:33.984547 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fc4dd663-2ea4-4c5b-b2de-3e7a295e549e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.057736 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fc4dd663-2ea4-4c5b-b2de-3e7a295e549e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:34.065513 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fc4dd663-2ea4-4c5b-b2de-3e7a295e549e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1191 microversion: 2.1 time: 0.104993 Jul 18 02:38:34.066455 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 255/506] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:33 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1191 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:34.201176 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e08605ca-5809-45c4-82e1-eb0964f78293 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:34.201797 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e08605ca-5809-45c4-82e1-eb0964f78293 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:34.208458 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e08605ca-5809-45c4-82e1-eb0964f78293 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.209064 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e08605ca-5809-45c4-82e1-eb0964f78293 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.209933 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e08605ca-5809-45c4-82e1-eb0964f78293 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.210403 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e08605ca-5809-45c4-82e1-eb0964f78293 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.376874 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e08605ca-5809-45c4-82e1-eb0964f78293 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:34.386478 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e08605ca-5809-45c4-82e1-eb0964f78293 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:34.390380 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e08605ca-5809-45c4-82e1-eb0964f78293 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:34.391603 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e08605ca-5809-45c4-82e1-eb0964f78293 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.196816 Jul 18 02:38:34.392365 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 252/507] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:34 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:34.929200 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1c8dc378-6392-406b-80e2-5a339dd16afe tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:34.929810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1c8dc378-6392-406b-80e2-5a339dd16afe tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:34.936126 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c8dc378-6392-406b-80e2-5a339dd16afe tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.940124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c8dc378-6392-406b-80e2-5a339dd16afe tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:34.940124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c8dc378-6392-406b-80e2-5a339dd16afe tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:34.940124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c8dc378-6392-406b-80e2-5a339dd16afe tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:35.015104 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1c8dc378-6392-406b-80e2-5a339dd16afe tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.030469 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1c8dc378-6392-406b-80e2-5a339dd16afe tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1300 microversion: 2.1 time: 0.105238 Jul 18 02:38:35.031434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 256/508] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:34 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:35.082937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7eb9203a-bf6b-4e3d-8891-4faf28eb7556 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:35.085775 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7eb9203a-bf6b-4e3d-8891-4faf28eb7556 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:35.091321 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7eb9203a-bf6b-4e3d-8891-4faf28eb7556 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:35.092280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7eb9203a-bf6b-4e3d-8891-4faf28eb7556 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:35.093225 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7eb9203a-bf6b-4e3d-8891-4faf28eb7556 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:35.094029 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7eb9203a-bf6b-4e3d-8891-4faf28eb7556 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:35.163765 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7eb9203a-bf6b-4e3d-8891-4faf28eb7556 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.172067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7eb9203a-bf6b-4e3d-8891-4faf28eb7556 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1191 microversion: 2.1 time: 0.093171 Jul 18 02:38:35.172796 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 253/509] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:35 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:35.410733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3d740536-cf54-41b0-9886-0448c869a102 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:35.411344 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3d740536-cf54-41b0-9886-0448c869a102 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:35.418350 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d740536-cf54-41b0-9886-0448c869a102 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:35.418805 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d740536-cf54-41b0-9886-0448c869a102 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:35.419565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d740536-cf54-41b0-9886-0448c869a102 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:35.419999 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d740536-cf54-41b0-9886-0448c869a102 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:35.585533 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3d740536-cf54-41b0-9886-0448c869a102 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.595048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3d740536-cf54-41b0-9886-0448c869a102 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.597061 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3d740536-cf54-41b0-9886-0448c869a102 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:35.598456 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3d740536-cf54-41b0-9886-0448c869a102 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.191623 Jul 18 02:38:35.599165 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 257/510] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:35 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:36.048435 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-49254da0-6703-4665-9d3d-cd900c353e34 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:36.049171 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-49254da0-6703-4665-9d3d-cd900c353e34 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:36.055511 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-49254da0-6703-4665-9d3d-cd900c353e34 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.055966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-49254da0-6703-4665-9d3d-cd900c353e34 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.056812 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-49254da0-6703-4665-9d3d-cd900c353e34 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.057591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-49254da0-6703-4665-9d3d-cd900c353e34 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.124843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-49254da0-6703-4665-9d3d-cd900c353e34 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.132650 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-49254da0-6703-4665-9d3d-cd900c353e34 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1300 microversion: 2.1 time: 0.088161 Jul 18 02:38:36.133221 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 254/511] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:36 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:36.193318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b9392da3-d61a-476b-a10d-35a5dc5e06f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:36.194005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b9392da3-d61a-476b-a10d-35a5dc5e06f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:36.201965 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b9392da3-d61a-476b-a10d-35a5dc5e06f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.202453 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b9392da3-d61a-476b-a10d-35a5dc5e06f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.203228 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b9392da3-d61a-476b-a10d-35a5dc5e06f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.203663 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b9392da3-d61a-476b-a10d-35a5dc5e06f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.275230 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b9392da3-d61a-476b-a10d-35a5dc5e06f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.283758 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b9392da3-d61a-476b-a10d-35a5dc5e06f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1191 microversion: 2.1 time: 0.095366 Jul 18 02:38:36.284324 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 258/512] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:36 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:36.616902 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4180ee31-96f5-4a90-9808-e1a608bc0a66 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:36.617520 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4180ee31-96f5-4a90-9808-e1a608bc0a66 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:36.624368 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4180ee31-96f5-4a90-9808-e1a608bc0a66 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.624820 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4180ee31-96f5-4a90-9808-e1a608bc0a66 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.625591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4180ee31-96f5-4a90-9808-e1a608bc0a66 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:36.626027 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4180ee31-96f5-4a90-9808-e1a608bc0a66 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:36.762774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4180ee31-96f5-4a90-9808-e1a608bc0a66 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.771570 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4180ee31-96f5-4a90-9808-e1a608bc0a66 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.773077 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4180ee31-96f5-4a90-9808-e1a608bc0a66 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:36.774317 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4180ee31-96f5-4a90-9808-e1a608bc0a66 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.161313 Jul 18 02:38:36.775062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 255/513] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:36 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:37.148715 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4d0f1a1a-ac93-4927-85f4-8781e6f7c6a1 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:37.149682 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4d0f1a1a-ac93-4927-85f4-8781e6f7c6a1 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:37.156136 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d0f1a1a-ac93-4927-85f4-8781e6f7c6a1 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.156579 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d0f1a1a-ac93-4927-85f4-8781e6f7c6a1 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.157336 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d0f1a1a-ac93-4927-85f4-8781e6f7c6a1 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.157788 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d0f1a1a-ac93-4927-85f4-8781e6f7c6a1 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.234895 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4d0f1a1a-ac93-4927-85f4-8781e6f7c6a1 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:37.241448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4d0f1a1a-ac93-4927-85f4-8781e6f7c6a1 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1300 microversion: 2.1 time: 0.096626 Jul 18 02:38:37.242016 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 259/514] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:37 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:37.301085 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8348dd93-ec74-4482-a2cb-189c38999714 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:37.301707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8348dd93-ec74-4482-a2cb-189c38999714 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:37.308360 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8348dd93-ec74-4482-a2cb-189c38999714 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.308896 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8348dd93-ec74-4482-a2cb-189c38999714 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.309667 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8348dd93-ec74-4482-a2cb-189c38999714 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.310306 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8348dd93-ec74-4482-a2cb-189c38999714 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.376254 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8348dd93-ec74-4482-a2cb-189c38999714 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:37.383711 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8348dd93-ec74-4482-a2cb-189c38999714 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1191 microversion: 2.1 time: 0.086733 Jul 18 02:38:37.384276 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 256/515] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:37 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:37.793732 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1de612f4-79c2-4cff-94ff-4cdd73a46578 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:37.794367 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1de612f4-79c2-4cff-94ff-4cdd73a46578 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:37.800557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1de612f4-79c2-4cff-94ff-4cdd73a46578 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.801003 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1de612f4-79c2-4cff-94ff-4cdd73a46578 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.801875 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1de612f4-79c2-4cff-94ff-4cdd73a46578 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:37.802209 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1de612f4-79c2-4cff-94ff-4cdd73a46578 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:37.934569 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1de612f4-79c2-4cff-94ff-4cdd73a46578 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:37.943506 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1de612f4-79c2-4cff-94ff-4cdd73a46578 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:37.945033 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1de612f4-79c2-4cff-94ff-4cdd73a46578 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:37.946228 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1de612f4-79c2-4cff-94ff-4cdd73a46578 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.157348 Jul 18 02:38:37.946794 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 260/516] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:37 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:38.258977 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:38.259628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:38.266375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.266827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.267595 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.268035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.299059 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.299507 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.299954 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lazy-loading 'fault' on Instance uuid 8b571193-bc0c-461f-b2ad-e3c66e93ba5d {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:38:38.341302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:38.348743 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-039f3dd6-f862-4147-a96d-d9a95f871b73 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1305 microversion: 2.1 time: 0.094042 Jul 18 02:38:38.349304 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 257/517] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:38 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:38.400708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f9fa43ee-2961-4c39-b6d1-b2e3465f9982 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:38.401344 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f9fa43ee-2961-4c39-b6d1-b2e3465f9982 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:38.407839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9fa43ee-2961-4c39-b6d1-b2e3465f9982 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.408287 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9fa43ee-2961-4c39-b6d1-b2e3465f9982 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.409050 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9fa43ee-2961-4c39-b6d1-b2e3465f9982 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.409488 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9fa43ee-2961-4c39-b6d1-b2e3465f9982 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.471111 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f9fa43ee-2961-4c39-b6d1-b2e3465f9982 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:38.479084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f9fa43ee-2961-4c39-b6d1-b2e3465f9982 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1199 microversion: 2.1 time: 0.081736 Jul 18 02:38:38.480120 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 261/518] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:38 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:38.965130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7ee65ed4-87fb-4138-85ef-420200c57b17 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:38.965774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7ee65ed4-87fb-4138-85ef-420200c57b17 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:38.971779 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7ee65ed4-87fb-4138-85ef-420200c57b17 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.972225 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7ee65ed4-87fb-4138-85ef-420200c57b17 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:38.972986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7ee65ed4-87fb-4138-85ef-420200c57b17 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:38.973418 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7ee65ed4-87fb-4138-85ef-420200c57b17 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:39.106450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7ee65ed4-87fb-4138-85ef-420200c57b17 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:39.114874 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7ee65ed4-87fb-4138-85ef-420200c57b17 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:39.116444 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7ee65ed4-87fb-4138-85ef-420200c57b17 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:39.117607 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7ee65ed4-87fb-4138-85ef-420200c57b17 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.156912 Jul 18 02:38:39.118183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 258/519] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:38 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:39.365786 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:39.366365 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:39.368228 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:39.373678 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:39.374142 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:39.374898 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:39.375330 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:39.404417 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:39.405090 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:39.405288 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lazy-loading 'fault' on Instance uuid 8b571193-bc0c-461f-b2ad-e3c66e93ba5d {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:38:39.447200 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:39.455585 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f2f1be28-9d7c-4400-99b2-a389b94527a4 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1305 microversion: 2.1 time: 0.093833 Jul 18 02:38:39.456157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 262/520] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:39 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:39.497056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-608a709a-f97b-423e-8c17-efa91d78e573 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:39.497697 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-608a709a-f97b-423e-8c17-efa91d78e573 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:39.504430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-608a709a-f97b-423e-8c17-efa91d78e573 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:39.504882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-608a709a-f97b-423e-8c17-efa91d78e573 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:39.505651 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-608a709a-f97b-423e-8c17-efa91d78e573 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:39.506116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-608a709a-f97b-423e-8c17-efa91d78e573 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:39.566913 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-608a709a-f97b-423e-8c17-efa91d78e573 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:39.575428 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-608a709a-f97b-423e-8c17-efa91d78e573 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1209 microversion: 2.1 time: 0.082906 Jul 18 02:38:39.575899 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 259/521] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:39 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:40.137518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-94305c45-3334-47b9-b449-d1328b570f67 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:40.138192 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-94305c45-3334-47b9-b449-d1328b570f67 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:40.144555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94305c45-3334-47b9-b449-d1328b570f67 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.145009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94305c45-3334-47b9-b449-d1328b570f67 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.145772 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94305c45-3334-47b9-b449-d1328b570f67 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.146235 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-94305c45-3334-47b9-b449-d1328b570f67 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.277705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-94305c45-3334-47b9-b449-d1328b570f67 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.285993 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-94305c45-3334-47b9-b449-d1328b570f67 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.287578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-94305c45-3334-47b9-b449-d1328b570f67 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.288669 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-94305c45-3334-47b9-b449-d1328b570f67 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.155748 Jul 18 02:38:40.289221 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 263/522] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:40 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:40.472679 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:40.473298 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:40.479604 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.480059 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.480827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.481270 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.512416 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.513047 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.513301 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lazy-loading 'fault' on Instance uuid 8b571193-bc0c-461f-b2ad-e3c66e93ba5d {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:38:40.553091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.560932 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0b84883c-7733-4a1d-aa12-4aaec0c9c3a5 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1305 microversion: 2.1 time: 0.092148 Jul 18 02:38:40.561500 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 260/523] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:40 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:40.596511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a4f0ca37-61bc-421d-bac4-543bdd4f78fa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:40.597162 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a4f0ca37-61bc-421d-bac4-543bdd4f78fa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:40.603719 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4f0ca37-61bc-421d-bac4-543bdd4f78fa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.604850 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4f0ca37-61bc-421d-bac4-543bdd4f78fa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.605657 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4f0ca37-61bc-421d-bac4-543bdd4f78fa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:40.606110 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4f0ca37-61bc-421d-bac4-543bdd4f78fa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:40.668982 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a4f0ca37-61bc-421d-bac4-543bdd4f78fa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:40.676471 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a4f0ca37-61bc-421d-bac4-543bdd4f78fa tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1209 microversion: 2.1 time: 0.083736 Jul 18 02:38:40.677028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 264/524] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:40 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:41.306768 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1a15b65a-e9e1-4a8d-8908-2808a184a329 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:41.307876 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1a15b65a-e9e1-4a8d-8908-2808a184a329 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.313965 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a15b65a-e9e1-4a8d-8908-2808a184a329 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.314440 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a15b65a-e9e1-4a8d-8908-2808a184a329 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.315196 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a15b65a-e9e1-4a8d-8908-2808a184a329 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.315624 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1a15b65a-e9e1-4a8d-8908-2808a184a329 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.446381 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1a15b65a-e9e1-4a8d-8908-2808a184a329 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:41.454812 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1a15b65a-e9e1-4a8d-8908-2808a184a329 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:41.456302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1a15b65a-e9e1-4a8d-8908-2808a184a329 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:41.457453 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1a15b65a-e9e1-4a8d-8908-2808a184a329 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.154551 Jul 18 02:38:41.458011 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 261/525] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:41 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:41.577604 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:41.578254 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.584168 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.584620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.585375 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.585813 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.616900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.617456 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.617779 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lazy-loading 'fault' on Instance uuid 8b571193-bc0c-461f-b2ad-e3c66e93ba5d {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:38:41.658449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '273664a60a334dc58ede22f9ccc0a128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba114b0e00424785a219aa31d987d2ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:41.666147 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4d07525c-1ebe-49b9-87c7-f9add5d82905 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 200 len: 1305 microversion: 2.1 time: 0.092312 Jul 18 02:38:41.667392 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 265/526] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:41 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:41.696097 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-dc39bc69-9b20-42ca-861c-06386fd8c462 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:41.696711 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-dc39bc69-9b20-42ca-861c-06386fd8c462 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.703357 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc39bc69-9b20-42ca-861c-06386fd8c462 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.703809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc39bc69-9b20-42ca-861c-06386fd8c462 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.704609 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc39bc69-9b20-42ca-861c-06386fd8c462 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.705047 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc39bc69-9b20-42ca-861c-06386fd8c462 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.767258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-dc39bc69-9b20-42ca-861c-06386fd8c462 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:41.768172 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bc23d82e-1985-4fc7-8ed3-7da90e983468 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:41.768668 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bc23d82e-1985-4fc7-8ed3-7da90e983468 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.774752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bc23d82e-1985-4fc7-8ed3-7da90e983468 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.775086 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-dc39bc69-9b20-42ca-861c-06386fd8c462 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1209 microversion: 2.1 time: 0.082865 Jul 18 02:38:41.775197 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bc23d82e-1985-4fc7-8ed3-7da90e983468 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.775663 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 262/527] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:41 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:41.776066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bc23d82e-1985-4fc7-8ed3-7da90e983468 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.776540 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bc23d82e-1985-4fc7-8ed3-7da90e983468 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.803021 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bc23d82e-1985-4fc7-8ed3-7da90e983468 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b/ips" status: 200 len: 150 microversion: 2.1 time: 0.038617 Jul 18 02:38:41.803595 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 266/528] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 18 02:38:41 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:38:41.814789 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b203e5f9-45ca-45b1-b294-cf81e13d0a59 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "978c3dee-b101-4468-925c-6179bb0bcd2b"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:41.815873 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b203e5f9-45ca-45b1-b294-cf81e13d0a59 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.821759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b203e5f9-45ca-45b1-b294-cf81e13d0a59 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.822239 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b203e5f9-45ca-45b1-b294-cf81e13d0a59 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.823138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b203e5f9-45ca-45b1-b294-cf81e13d0a59 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.823622 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b203e5f9-45ca-45b1-b294-cf81e13d0a59 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.918010 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-b203e5f9-45ca-45b1-b294-cf81e13d0a59 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Invalid volume: volume 978c3dee-b101-4468-925c-6179bb0bcd2b is already attached to instances: b883c80f-57dd-43cb-a44e-72b33a2128e9 Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b203e5f9-45ca-45b1-b294-cf81e13d0a59 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: POST /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b/os-volume_attachments HTTP/1.1 Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 74 Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:38:41.920090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {"volumeAttachment": {"volumeId": "978c3dee-b101-4468-925c-6179bb0bcd2b"}} Jul 18 02:38:41.921882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Invalid volume: volume 978c3dee-b101-4468-925c-6179bb0bcd2b is already attached to instances: b883c80f-57dd-43cb-a44e-72b33a2128e9 Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'server_id': '5b66be0c-5ad3-410b-94f2-74110dcffc9b', 'body': {'volumeAttachment': {'volumeId': '978c3dee-b101-4468-925c-6179bb0bcd2b'}}} Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 978c3dee-b101-4468-925c-6179bb0bcd2b is already attached to instances: b883c80f-57dd-43cb-a44e-72b33a2128e9 Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:38:41.928809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 978c3dee-b101-4468-925c-6179bb0bcd2b is already attached to instances: b883c80f-57dd-43cb-a44e-72b33a2128e9 Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:41.930264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:41.931718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:41.931718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:38:41.931718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:38:41.931718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 978c3dee-b101-4468-925c-6179bb0bcd2b is already attached to instances: b883c80f-57dd-43cb-a44e-72b33a2128e9 Jul 18 02:38:41.931718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:38:41.931718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b203e5f9-45ca-45b1-b294-cf81e13d0a59 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 400 to user: Invalid volume: volume 978c3dee-b101-4468-925c-6179bb0bcd2b is already attached to instances: b883c80f-57dd-43cb-a44e-72b33a2128e9 {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:38:41.931718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b203e5f9-45ca-45b1-b294-cf81e13d0a59 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111076 Jul 18 02:38:41.931718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 263/529] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:38:41 2022] POST /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:38:41.932554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1d5f9472-a725-4c9e-a76f-832c3563e625 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:41.932554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1d5f9472-a725-4c9e-a76f-832c3563e625 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:41.937201 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d5f9472-a725-4c9e-a76f-832c3563e625 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.937651 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d5f9472-a725-4c9e-a76f-832c3563e625 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.938445 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d5f9472-a725-4c9e-a76f-832c3563e625 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:41.938883 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d5f9472-a725-4c9e-a76f-832c3563e625 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:41.971354 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1d5f9472-a725-4c9e-a76f-832c3563e625 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Going to try to terminate instance {{(pid=124890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:38:42.367416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1d5f9472-a725-4c9e-a76f-832c3563e625 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 204 len: 0 microversion: 2.1 time: 0.440107 Jul 18 02:38:42.368149 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 267/530] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:38:41 2022] DELETE /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:38:42.376718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8a8f8fe5-53d7-4d7b-95f4-07f9a11f4641 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:42.377443 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8a8f8fe5-53d7-4d7b-95f4-07f9a11f4641 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:42.384546 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a8f8fe5-53d7-4d7b-95f4-07f9a11f4641 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.385002 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a8f8fe5-53d7-4d7b-95f4-07f9a11f4641 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.386332 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a8f8fe5-53d7-4d7b-95f4-07f9a11f4641 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.386818 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a8f8fe5-53d7-4d7b-95f4-07f9a11f4641 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.477135 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e29f00d7-75a9-4e19-a7d8-3d04137f28e4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:42.481863 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e29f00d7-75a9-4e19-a7d8-3d04137f28e4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:42.484191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e29f00d7-75a9-4e19-a7d8-3d04137f28e4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.484635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e29f00d7-75a9-4e19-a7d8-3d04137f28e4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.485433 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e29f00d7-75a9-4e19-a7d8-3d04137f28e4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.485861 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e29f00d7-75a9-4e19-a7d8-3d04137f28e4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.592821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8a8f8fe5-53d7-4d7b-95f4-07f9a11f4641 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:42.595331 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:42.601941 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8a8f8fe5-53d7-4d7b-95f4-07f9a11f4641 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1682 microversion: 2.1 time: 0.229138 Jul 18 02:38:42.602838 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 264/531] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:42 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:42.635361 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e29f00d7-75a9-4e19-a7d8-3d04137f28e4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:42.643939 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e29f00d7-75a9-4e19-a7d8-3d04137f28e4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:42.645456 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e29f00d7-75a9-4e19-a7d8-3d04137f28e4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:42.646729 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e29f00d7-75a9-4e19-a7d8-3d04137f28e4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.174511 Jul 18 02:38:42.647269 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 268/532] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:42 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:42.686177 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-763b554c-b70c-4dd1-a176-990a49692103 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:42.686828 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-763b554c-b70c-4dd1-a176-990a49692103 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] [instance: 8b571193-bc0c-461f-b2ad-e3c66e93ba5d] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:42.693384 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-763b554c-b70c-4dd1-a176-990a49692103 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.693926 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-763b554c-b70c-4dd1-a176-990a49692103 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.694648 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-763b554c-b70c-4dd1-a176-990a49692103 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.695093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-763b554c-b70c-4dd1-a176-990a49692103 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.710397 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-763b554c-b70c-4dd1-a176-990a49692103 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] HTTP exception thrown: Instance 8b571193-bc0c-461f-b2ad-e3c66e93ba5d could not be found. Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-763b554c-b70c-4dd1-a176-990a49692103 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Request method failure captured: Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d HTTP/1.1 Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MeC7qREoXs5ebjArYUJe5_mz-kKZ63dgfsWHOBkdnSZVED3MWPkEAmc7w2M8rao1MwHEuU_3ERfFR9Fp_G_vctrp4qXTADNVRFmp2agaEgHwK2KcY5XJax7UcFvOJp6HVc1ZTSfjmb8AkDAYD7OL0PCvwT-KNMIhSoYdJ8PEBcIalk Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: ba114b0e00424785a219aa31d987d2ee Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesNegativeTest-1030366677 Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:38:42.710974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ba114b0e00424785a219aa31d987d2ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ba114b0e00424785a219aa31d987d2ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ba114b0e00424785a219aa31d987d2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ba114b0e00424785a219aa31d987d2ee", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesNegativeTest-1030366677 Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: ba114b0e00424785a219aa31d987d2ee Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesNegativeTest-1030366677 Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesNegativeTest-1030366677-project Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 273664a60a334dc58ede22f9ccc0a128 Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesNegativeTest-1030366677-project Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 8b571193-bc0c-461f-b2ad-e3c66e93ba5d could not be found. Jul 18 02:38:42.712410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '8b571193-bc0c-461f-b2ad-e3c66e93ba5d'} Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b571193-bc0c-461f-b2ad-e3c66e93ba5d could not be found. Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:38:42.713207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b571193-bc0c-461f-b2ad-e3c66e93ba5d could not be found. Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b571193-bc0c-461f-b2ad-e3c66e93ba5d could not be found. Jul 18 02:38:42.715353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:38:42.716568 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-763b554c-b70c-4dd1-a176-990a49692103 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] Returning 404 to user: Instance 8b571193-bc0c-461f-b2ad-e3c66e93ba5d could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:38:42.716568 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-763b554c-b70c-4dd1-a176-990a49692103 tempest-VolumesNegativeTest-1030366677 tempest-VolumesNegativeTest-1030366677-project] 10.222.0.66 "GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d" status: 404 len: 111 microversion: 2.1 time: 0.030260 Jul 18 02:38:42.716568 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 265/533] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:42 2022] GET /compute/v2.1/servers/8b571193-bc0c-461f-b2ad-e3c66e93ba5d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:38:42.792038 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-eac42d41-0334-4210-a0b9-74de8f001613 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:42.792698 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-eac42d41-0334-4210-a0b9-74de8f001613 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:42.799303 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eac42d41-0334-4210-a0b9-74de8f001613 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.799755 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eac42d41-0334-4210-a0b9-74de8f001613 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.800504 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eac42d41-0334-4210-a0b9-74de8f001613 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:42.800934 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eac42d41-0334-4210-a0b9-74de8f001613 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:42.805305 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:42.862191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-eac42d41-0334-4210-a0b9-74de8f001613 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:42.870951 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-eac42d41-0334-4210-a0b9-74de8f001613 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1209 microversion: 2.1 time: 0.082829 Jul 18 02:38:42.871709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 269/534] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:42 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:43.621120 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-81433eb7-645a-47c8-b849-9e5ac92348c4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:43.621758 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-81433eb7-645a-47c8-b849-9e5ac92348c4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:43.627892 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-81433eb7-645a-47c8-b849-9e5ac92348c4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:43.628377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-81433eb7-645a-47c8-b849-9e5ac92348c4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:43.629140 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-81433eb7-645a-47c8-b849-9e5ac92348c4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:43.629585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-81433eb7-645a-47c8-b849-9e5ac92348c4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:43.665226 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cadfb296-1333-424f-b1d1-c7fde0157969 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:43.665841 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cadfb296-1333-424f-b1d1-c7fde0157969 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:43.674108 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cadfb296-1333-424f-b1d1-c7fde0157969 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:43.674621 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cadfb296-1333-424f-b1d1-c7fde0157969 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:43.675468 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cadfb296-1333-424f-b1d1-c7fde0157969 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:43.675882 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cadfb296-1333-424f-b1d1-c7fde0157969 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:43.767515 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-81433eb7-645a-47c8-b849-9e5ac92348c4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:43.775438 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-81433eb7-645a-47c8-b849-9e5ac92348c4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1682 microversion: 2.1 time: 0.158443 Jul 18 02:38:43.776995 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 266/535] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:43 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:43.815170 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cadfb296-1333-424f-b1d1-c7fde0157969 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:43.824133 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cadfb296-1333-424f-b1d1-c7fde0157969 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:43.835273 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cadfb296-1333-424f-b1d1-c7fde0157969 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:43.835273 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cadfb296-1333-424f-b1d1-c7fde0157969 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.165862 Jul 18 02:38:43.835273 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 270/536] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:43 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:43.888709 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8f23b2f4-ac83-4e7c-b5b8-66a13a11e1f3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:43.889405 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8f23b2f4-ac83-4e7c-b5b8-66a13a11e1f3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:43.898684 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8f23b2f4-ac83-4e7c-b5b8-66a13a11e1f3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:43.898684 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8f23b2f4-ac83-4e7c-b5b8-66a13a11e1f3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:43.898684 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8f23b2f4-ac83-4e7c-b5b8-66a13a11e1f3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:43.898684 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8f23b2f4-ac83-4e7c-b5b8-66a13a11e1f3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.033000 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8f23b2f4-ac83-4e7c-b5b8-66a13a11e1f3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:44.041197 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8f23b2f4-ac83-4e7c-b5b8-66a13a11e1f3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1277 microversion: 2.1 time: 0.156952 Jul 18 02:38:44.041975 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 267/537] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:43 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:44.794026 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-48e135df-41f6-45f4-b49a-147b6304f60d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:44.794870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-48e135df-41f6-45f4-b49a-147b6304f60d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:44.801783 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-48e135df-41f6-45f4-b49a-147b6304f60d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.802270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-48e135df-41f6-45f4-b49a-147b6304f60d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.803040 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-48e135df-41f6-45f4-b49a-147b6304f60d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.803483 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-48e135df-41f6-45f4-b49a-147b6304f60d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.845341 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fd3c7fc2-984a-4ed2-83d0-d31833dc118d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:44.845957 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fd3c7fc2-984a-4ed2-83d0-d31833dc118d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:44.852751 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fd3c7fc2-984a-4ed2-83d0-d31833dc118d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.853236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fd3c7fc2-984a-4ed2-83d0-d31833dc118d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.854040 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fd3c7fc2-984a-4ed2-83d0-d31833dc118d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:44.854550 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fd3c7fc2-984a-4ed2-83d0-d31833dc118d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:44.942874 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-48e135df-41f6-45f4-b49a-147b6304f60d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:44.954625 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-48e135df-41f6-45f4-b49a-147b6304f60d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1682 microversion: 2.1 time: 0.165023 Jul 18 02:38:44.956277 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 271/538] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:44 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:45.021669 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fd3c7fc2-984a-4ed2-83d0-d31833dc118d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:45.031740 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fd3c7fc2-984a-4ed2-83d0-d31833dc118d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:45.033329 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fd3c7fc2-984a-4ed2-83d0-d31833dc118d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:45.034716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fd3c7fc2-984a-4ed2-83d0-d31833dc118d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.193273 Jul 18 02:38:45.035457 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 268/539] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:44 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:45.059186 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fa6f5276-b1a3-46ea-bb60-8e487f08b3dc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:45.059807 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fa6f5276-b1a3-46ea-bb60-8e487f08b3dc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:45.066612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa6f5276-b1a3-46ea-bb60-8e487f08b3dc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:45.067066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa6f5276-b1a3-46ea-bb60-8e487f08b3dc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:45.067838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa6f5276-b1a3-46ea-bb60-8e487f08b3dc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:45.068317 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa6f5276-b1a3-46ea-bb60-8e487f08b3dc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:45.207475 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fa6f5276-b1a3-46ea-bb60-8e487f08b3dc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:45.215587 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fa6f5276-b1a3-46ea-bb60-8e487f08b3dc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1277 microversion: 2.1 time: 0.160993 Jul 18 02:38:45.216132 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 272/540] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:45 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:45.972019 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0ccc5561-a94c-467d-85d4-a4a9f61022a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:45.972635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0ccc5561-a94c-467d-85d4-a4a9f61022a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:45.979152 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ccc5561-a94c-467d-85d4-a4a9f61022a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:45.979803 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ccc5561-a94c-467d-85d4-a4a9f61022a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:45.980789 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ccc5561-a94c-467d-85d4-a4a9f61022a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:45.981232 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0ccc5561-a94c-467d-85d4-a4a9f61022a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.053107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d15ef7ec-de93-4439-ac49-5f6be2b38a35 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:46.054371 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d15ef7ec-de93-4439-ac49-5f6be2b38a35 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:46.064156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d15ef7ec-de93-4439-ac49-5f6be2b38a35 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.064156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d15ef7ec-de93-4439-ac49-5f6be2b38a35 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.064156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d15ef7ec-de93-4439-ac49-5f6be2b38a35 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.064156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d15ef7ec-de93-4439-ac49-5f6be2b38a35 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.112714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0ccc5561-a94c-467d-85d4-a4a9f61022a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.120233 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0ccc5561-a94c-467d-85d4-a4a9f61022a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1682 microversion: 2.1 time: 0.152121 Jul 18 02:38:46.120993 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 269/541] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:45 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:46.204125 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d15ef7ec-de93-4439-ac49-5f6be2b38a35 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.213480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d15ef7ec-de93-4439-ac49-5f6be2b38a35 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.214903 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d15ef7ec-de93-4439-ac49-5f6be2b38a35 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.216077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d15ef7ec-de93-4439-ac49-5f6be2b38a35 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.167118 Jul 18 02:38:46.216628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 273/542] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:46 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:46.232080 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-672a4339-e066-4064-8c79-95bf2f8b65f7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:46.233749 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-672a4339-e066-4064-8c79-95bf2f8b65f7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:46.239302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-672a4339-e066-4064-8c79-95bf2f8b65f7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.239766 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-672a4339-e066-4064-8c79-95bf2f8b65f7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.240550 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-672a4339-e066-4064-8c79-95bf2f8b65f7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:46.240991 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-672a4339-e066-4064-8c79-95bf2f8b65f7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:46.383126 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-672a4339-e066-4064-8c79-95bf2f8b65f7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:46.391441 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-672a4339-e066-4064-8c79-95bf2f8b65f7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1277 microversion: 2.1 time: 0.163111 Jul 18 02:38:46.392018 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 270/543] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:46 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:47.137466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-60f61c49-aadc-44b3-9a7e-72c22902f218 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:47.138274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-60f61c49-aadc-44b3-9a7e-72c22902f218 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:47.144608 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60f61c49-aadc-44b3-9a7e-72c22902f218 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.145054 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60f61c49-aadc-44b3-9a7e-72c22902f218 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.145810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60f61c49-aadc-44b3-9a7e-72c22902f218 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.146443 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-60f61c49-aadc-44b3-9a7e-72c22902f218 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.241731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bc3396df-b06b-4db4-ac2d-d21da5637ece tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:47.241731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bc3396df-b06b-4db4-ac2d-d21da5637ece tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:47.248745 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bc3396df-b06b-4db4-ac2d-d21da5637ece tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.249480 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bc3396df-b06b-4db4-ac2d-d21da5637ece tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.250592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bc3396df-b06b-4db4-ac2d-d21da5637ece tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.251224 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bc3396df-b06b-4db4-ac2d-d21da5637ece tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.315302 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-60f61c49-aadc-44b3-9a7e-72c22902f218 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:47.327504 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-60f61c49-aadc-44b3-9a7e-72c22902f218 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1682 microversion: 2.1 time: 0.194058 Jul 18 02:38:47.328437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 274/544] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:47 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:47.408386 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c99ce9e1-954a-4308-8da2-f0f968275a9a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:47.409003 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c99ce9e1-954a-4308-8da2-f0f968275a9a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:47.415290 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c99ce9e1-954a-4308-8da2-f0f968275a9a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.415881 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c99ce9e1-954a-4308-8da2-f0f968275a9a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.416968 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c99ce9e1-954a-4308-8da2-f0f968275a9a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.417915 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c99ce9e1-954a-4308-8da2-f0f968275a9a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.484869 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bc3396df-b06b-4db4-ac2d-d21da5637ece tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:47.505605 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bc3396df-b06b-4db4-ac2d-d21da5637ece tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:47.507560 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bc3396df-b06b-4db4-ac2d-d21da5637ece tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:47.509815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bc3396df-b06b-4db4-ac2d-d21da5637ece tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.277562 Jul 18 02:38:47.510507 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 271/545] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:47 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:47.577795 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c99ce9e1-954a-4308-8da2-f0f968275a9a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:47.598894 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c99ce9e1-954a-4308-8da2-f0f968275a9a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1277 microversion: 2.1 time: 0.183502 Jul 18 02:38:47.598894 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 275/546] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:47 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:47.828841 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-91c52bad-57d7-4ac6-80e9-e1cd6cf6e38b req-7213aa46-7736-4c66-a64f-675f01b5c5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7697d1-40ec-4c17-979a-de45d737eac5", "tag": "3ff30934-3b2b-494c-bbcf-58c1f9f9094e"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:47.838179 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-91c52bad-57d7-4ac6-80e9-e1cd6cf6e38b req-7213aa46-7736-4c66-a64f-675f01b5c5d3 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:47.838605 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-91c52bad-57d7-4ac6-80e9-e1cd6cf6e38b req-7213aa46-7736-4c66-a64f-675f01b5c5d3 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:47.859097 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-91c52bad-57d7-4ac6-80e9-e1cd6cf6e38b req-7213aa46-7736-4c66-a64f-675f01b5c5d3 service nova] Creating event network-changed:3ff30934-3b2b-494c-bbcf-58c1f9f9094e for instance fb7697d1-40ec-4c17-979a-de45d737eac5 on hv-cinder-85001 Jul 18 02:38:47.864310 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-91c52bad-57d7-4ac6-80e9-e1cd6cf6e38b req-7213aa46-7736-4c66-a64f-675f01b5c5d3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039388 Jul 18 02:38:47.864918 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 272/547] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:48.345297 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8e61ea9f-11c8-4855-84d6-bddac2ea5e63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:48.345914 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8e61ea9f-11c8-4855-84d6-bddac2ea5e63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:48.352542 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8e61ea9f-11c8-4855-84d6-bddac2ea5e63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.352997 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8e61ea9f-11c8-4855-84d6-bddac2ea5e63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.353765 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8e61ea9f-11c8-4855-84d6-bddac2ea5e63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.354251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8e61ea9f-11c8-4855-84d6-bddac2ea5e63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.529609 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ee047bc5-46c6-473d-ae02-73a5da259f6a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:48.530375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ee047bc5-46c6-473d-ae02-73a5da259f6a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:48.537358 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ee047bc5-46c6-473d-ae02-73a5da259f6a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.537810 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ee047bc5-46c6-473d-ae02-73a5da259f6a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.538617 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ee047bc5-46c6-473d-ae02-73a5da259f6a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.539060 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ee047bc5-46c6-473d-ae02-73a5da259f6a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.681561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ee047bc5-46c6-473d-ae02-73a5da259f6a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:48.684029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8e61ea9f-11c8-4855-84d6-bddac2ea5e63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:48.691667 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8e61ea9f-11c8-4855-84d6-bddac2ea5e63 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1682 microversion: 2.1 time: 0.350197 Jul 18 02:38:48.701982 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 276/548] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:48 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1682 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:48.710289 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ee047bc5-46c6-473d-ae02-73a5da259f6a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:48.710289 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ee047bc5-46c6-473d-ae02-73a5da259f6a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:48.710289 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ee047bc5-46c6-473d-ae02-73a5da259f6a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.170719 Jul 18 02:38:48.710625 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 273/549] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:48 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:48.710718 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-75fcacd6-1e85-4d3e-8d10-a316083fa00a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:48.710718 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-75fcacd6-1e85-4d3e-8d10-a316083fa00a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:48.712963 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75fcacd6-1e85-4d3e-8d10-a316083fa00a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.713414 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75fcacd6-1e85-4d3e-8d10-a316083fa00a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.714231 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75fcacd6-1e85-4d3e-8d10-a316083fa00a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:48.714669 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75fcacd6-1e85-4d3e-8d10-a316083fa00a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:48.847672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-75fcacd6-1e85-4d3e-8d10-a316083fa00a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:48.855402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-75fcacd6-1e85-4d3e-8d10-a316083fa00a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1277 microversion: 2.1 time: 0.162091 Jul 18 02:38:48.865318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 277/550] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:48 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:49.708729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8c969e69-8192-498b-9671-5b18a5857188 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:49.709553 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8c969e69-8192-498b-9671-5b18a5857188 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:49.714986 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-89668b4c-90b3-4aa1-a1f8-f8c3c20e41ef tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:49.715677 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-89668b4c-90b3-4aa1-a1f8-f8c3c20e41ef tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:49.716686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8c969e69-8192-498b-9671-5b18a5857188 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.717141 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8c969e69-8192-498b-9671-5b18a5857188 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.717900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8c969e69-8192-498b-9671-5b18a5857188 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.718363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8c969e69-8192-498b-9671-5b18a5857188 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.722069 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-89668b4c-90b3-4aa1-a1f8-f8c3c20e41ef tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.722545 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-89668b4c-90b3-4aa1-a1f8-f8c3c20e41ef tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.723349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-89668b4c-90b3-4aa1-a1f8-f8c3c20e41ef tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.723826 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-89668b4c-90b3-4aa1-a1f8-f8c3c20e41ef tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.854256 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8c969e69-8192-498b-9671-5b18a5857188 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:49.858825 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-89668b4c-90b3-4aa1-a1f8-f8c3c20e41ef tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:49.862253 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8c969e69-8192-498b-9671-5b18a5857188 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1682 microversion: 2.1 time: 0.157285 Jul 18 02:38:49.862930 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 274/551] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:49 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:49.867528 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-89668b4c-90b3-4aa1-a1f8-f8c3c20e41ef tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:49.874792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-89668b4c-90b3-4aa1-a1f8-f8c3c20e41ef tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:49.874792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-89668b4c-90b3-4aa1-a1f8-f8c3c20e41ef tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.160012 Jul 18 02:38:49.874792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 278/552] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:49 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:49.875161 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f0b1149c-3da9-418c-a533-874b42a3af06 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:49.875773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f0b1149c-3da9-418c-a533-874b42a3af06 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:49.881732 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b1149c-3da9-418c-a533-874b42a3af06 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.882214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b1149c-3da9-418c-a533-874b42a3af06 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:49.882989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b1149c-3da9-418c-a533-874b42a3af06 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:49.883475 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b1149c-3da9-418c-a533-874b42a3af06 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.030944 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f0b1149c-3da9-418c-a533-874b42a3af06 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:50.038834 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f0b1149c-3da9-418c-a533-874b42a3af06 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1277 microversion: 2.1 time: 0.167300 Jul 18 02:38:50.039456 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 275/553] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:49 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:50.879286 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c8e8ea33-aa5d-440f-84cb-c8de6afc3863 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:50.879855 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c8e8ea33-aa5d-440f-84cb-c8de6afc3863 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:50.886462 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8e8ea33-aa5d-440f-84cb-c8de6afc3863 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:50.887006 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8e8ea33-aa5d-440f-84cb-c8de6afc3863 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.887786 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8e8ea33-aa5d-440f-84cb-c8de6afc3863 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:50.888228 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8e8ea33-aa5d-440f-84cb-c8de6afc3863 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.889043 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d7bb95eb-afb9-42b1-8b81-a8cf0a5fb360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:50.889872 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d7bb95eb-afb9-42b1-8b81-a8cf0a5fb360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:50.893020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:50.898912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d7bb95eb-afb9-42b1-8b81-a8cf0a5fb360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:50.899459 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d7bb95eb-afb9-42b1-8b81-a8cf0a5fb360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:50.900319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d7bb95eb-afb9-42b1-8b81-a8cf0a5fb360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:50.900817 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d7bb95eb-afb9-42b1-8b81-a8cf0a5fb360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:51.021787 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c8e8ea33-aa5d-440f-84cb-c8de6afc3863 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:51.029872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c8e8ea33-aa5d-440f-84cb-c8de6afc3863 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1682 microversion: 2.1 time: 0.154412 Jul 18 02:38:51.030508 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 279/554] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:50 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:51.037797 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d7bb95eb-afb9-42b1-8b81-a8cf0a5fb360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:51.047969 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d7bb95eb-afb9-42b1-8b81-a8cf0a5fb360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:51.049474 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d7bb95eb-afb9-42b1-8b81-a8cf0a5fb360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:51.050675 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d7bb95eb-afb9-42b1-8b81-a8cf0a5fb360 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.165966 Jul 18 02:38:51.051243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 276/555] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:50 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:51.057203 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-838ec0dd-d620-42c0-aad5-dc5e1835fa0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:51.058179 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-838ec0dd-d620-42c0-aad5-dc5e1835fa0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:51.064229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-838ec0dd-d620-42c0-aad5-dc5e1835fa0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:51.064656 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-838ec0dd-d620-42c0-aad5-dc5e1835fa0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:51.065412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-838ec0dd-d620-42c0-aad5-dc5e1835fa0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:51.065839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-838ec0dd-d620-42c0-aad5-dc5e1835fa0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:51.200109 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-838ec0dd-d620-42c0-aad5-dc5e1835fa0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:51.207981 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-838ec0dd-d620-42c0-aad5-dc5e1835fa0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1277 microversion: 2.1 time: 0.155885 Jul 18 02:38:51.208554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 280/556] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:51 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:52.049108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-da1c5dd6-f4de-43a9-9f61-f38067eafc55 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:52.050605 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-da1c5dd6-f4de-43a9-9f61-f38067eafc55 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:52.057605 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da1c5dd6-f4de-43a9-9f61-f38067eafc55 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.058882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da1c5dd6-f4de-43a9-9f61-f38067eafc55 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.060175 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da1c5dd6-f4de-43a9-9f61-f38067eafc55 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.060794 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da1c5dd6-f4de-43a9-9f61-f38067eafc55 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.072419 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-815adaa4-d616-46a2-8186-db3805c0d9af tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:52.072419 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-815adaa4-d616-46a2-8186-db3805c0d9af tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:52.077699 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-815adaa4-d616-46a2-8186-db3805c0d9af tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.078450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-815adaa4-d616-46a2-8186-db3805c0d9af tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.079469 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-815adaa4-d616-46a2-8186-db3805c0d9af tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.080114 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-815adaa4-d616-46a2-8186-db3805c0d9af tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.246422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-815adaa4-d616-46a2-8186-db3805c0d9af tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.255572 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-815adaa4-d616-46a2-8186-db3805c0d9af tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.257058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-815adaa4-d616-46a2-8186-db3805c0d9af tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.265141 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-815adaa4-d616-46a2-8186-db3805c0d9af tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.193533 Jul 18 02:38:52.265141 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 281/557] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:52 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:52.271127 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e1c2a27c-357e-4a6e-a404-22b2bb2d030e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:52.271743 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e1c2a27c-357e-4a6e-a404-22b2bb2d030e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:52.278786 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1c2a27c-357e-4a6e-a404-22b2bb2d030e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.279233 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1c2a27c-357e-4a6e-a404-22b2bb2d030e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.280012 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1c2a27c-357e-4a6e-a404-22b2bb2d030e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.280445 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1c2a27c-357e-4a6e-a404-22b2bb2d030e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.431295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e1c2a27c-357e-4a6e-a404-22b2bb2d030e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.439977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e1c2a27c-357e-4a6e-a404-22b2bb2d030e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.179802 Jul 18 02:38:52.441536 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 282/558] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:52 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:52.619481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-da1c5dd6-f4de-43a9-9f61-f38067eafc55 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:52.627705 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-da1c5dd6-f4de-43a9-9f61-f38067eafc55 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1682 microversion: 2.1 time: 0.582596 Jul 18 02:38:52.628367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 277/559] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:52 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1682 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:52.974053 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-7d0f8e1d-51c5-4166-8d7b-72e1dd5851bb req-fae08a8d-cae3-4e50-81ee-9cb7b19f23e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b66be0c-5ad3-410b-94f2-74110dcffc9b", "name": "network-vif-deleted", "tag": "0722fc37-f557-4503-a3a5-66878f8d3c27"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:52.982938 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-7d0f8e1d-51c5-4166-8d7b-72e1dd5851bb req-fae08a8d-cae3-4e50-81ee-9cb7b19f23e3 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:52.983379 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-7d0f8e1d-51c5-4166-8d7b-72e1dd5851bb req-fae08a8d-cae3-4e50-81ee-9cb7b19f23e3 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:52.995061 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-7d0f8e1d-51c5-4166-8d7b-72e1dd5851bb req-fae08a8d-cae3-4e50-81ee-9cb7b19f23e3 service nova] Creating event network-vif-deleted:0722fc37-f557-4503-a3a5-66878f8d3c27 for instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b on hv-cinder-85001 Jul 18 02:38:53.000323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-7d0f8e1d-51c5-4166-8d7b-72e1dd5851bb req-fae08a8d-cae3-4e50-81ee-9cb7b19f23e3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029972 Jul 18 02:38:53.000922 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 283/560] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:53.277753 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0351fea1-5dfd-42f0-8bb8-34070af0f9f2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:53.278688 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0351fea1-5dfd-42f0-8bb8-34070af0f9f2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:53.285618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0351fea1-5dfd-42f0-8bb8-34070af0f9f2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.286165 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0351fea1-5dfd-42f0-8bb8-34070af0f9f2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.287018 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0351fea1-5dfd-42f0-8bb8-34070af0f9f2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.287527 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0351fea1-5dfd-42f0-8bb8-34070af0f9f2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.428281 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0351fea1-5dfd-42f0-8bb8-34070af0f9f2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.438330 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0351fea1-5dfd-42f0-8bb8-34070af0f9f2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.439954 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0351fea1-5dfd-42f0-8bb8-34070af0f9f2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.441126 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0351fea1-5dfd-42f0-8bb8-34070af0f9f2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.168201 Jul 18 02:38:53.441879 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 278/561] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:53 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:53.460209 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-24862996-dd51-4b8e-9db0-78ea8cff8673 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:53.461040 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-24862996-dd51-4b8e-9db0-78ea8cff8673 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:53.468868 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24862996-dd51-4b8e-9db0-78ea8cff8673 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.469542 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24862996-dd51-4b8e-9db0-78ea8cff8673 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.470619 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24862996-dd51-4b8e-9db0-78ea8cff8673 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.471856 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24862996-dd51-4b8e-9db0-78ea8cff8673 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.587459 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-0872bd48-04d0-4f50-afcf-d43e0fd70af4 req-96fedee1-7ca5-4622-86b6-8b05ae3a9ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d974b9-4abf-4d7f-bbea-08e8fef381dd", "name": "network-vif-plugged", "status": "completed", "tag": "3185ab6e-a508-4ad1-b269-07229430860b"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:38:53.616855 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-0872bd48-04d0-4f50-afcf-d43e0fd70af4 req-96fedee1-7ca5-4622-86b6-8b05ae3a9ee7 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.619127 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-0872bd48-04d0-4f50-afcf-d43e0fd70af4 req-96fedee1-7ca5-4622-86b6-8b05ae3a9ee7 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.629211 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-24862996-dd51-4b8e-9db0-78ea8cff8673 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.633501 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-0872bd48-04d0-4f50-afcf-d43e0fd70af4 req-96fedee1-7ca5-4622-86b6-8b05ae3a9ee7 service nova] Creating event network-vif-plugged:3185ab6e-a508-4ad1-b269-07229430860b for instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd on hv-cinder-85001 Jul 18 02:38:53.639602 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-24862996-dd51-4b8e-9db0-78ea8cff8673 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.183228 Jul 18 02:38:53.639602 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 284/562] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:53 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:53.641931 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-0872bd48-04d0-4f50-afcf-d43e0fd70af4 req-96fedee1-7ca5-4622-86b6-8b05ae3a9ee7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059663 Jul 18 02:38:53.644774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 279/563] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:53.648256 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:53.648934 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:53.655539 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.655999 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.656823 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.657257 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.689365 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:53.690073 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:53.690717 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lazy-loading 'fault' on Instance uuid 5b66be0c-5ad3-410b-94f2-74110dcffc9b {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:38:53.748846 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:53.757068 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f4599ba9-23a4-4649-b536-3b3f72314bd0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1331 microversion: 2.1 time: 0.113998 Jul 18 02:38:53.758530 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 285/564] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:53 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:54.460860 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7dc47074-3e63-44ee-8547-63ebf8414698 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:54.461590 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7dc47074-3e63-44ee-8547-63ebf8414698 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:54.470748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7dc47074-3e63-44ee-8547-63ebf8414698 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.476481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7dc47074-3e63-44ee-8547-63ebf8414698 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.476481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7dc47074-3e63-44ee-8547-63ebf8414698 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.476481 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7dc47074-3e63-44ee-8547-63ebf8414698 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.660424 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0f6c48a9-7a8c-4f88-8cbc-ca468986cda2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:54.660909 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7dc47074-3e63-44ee-8547-63ebf8414698 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.661055 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0f6c48a9-7a8c-4f88-8cbc-ca468986cda2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:54.666066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0f6c48a9-7a8c-4f88-8cbc-ca468986cda2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.666537 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0f6c48a9-7a8c-4f88-8cbc-ca468986cda2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.667317 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0f6c48a9-7a8c-4f88-8cbc-ca468986cda2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.668479 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0f6c48a9-7a8c-4f88-8cbc-ca468986cda2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.673219 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7dc47074-3e63-44ee-8547-63ebf8414698 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.673398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:54.676364 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7dc47074-3e63-44ee-8547-63ebf8414698 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.678866 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7dc47074-3e63-44ee-8547-63ebf8414698 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.222708 Jul 18 02:38:54.680088 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 280/565] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:54 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:54.776170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:54.777466 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:54.784009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.784828 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.785789 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.786512 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.817052 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0f6c48a9-7a8c-4f88-8cbc-ca468986cda2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.820808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:54.821326 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:54.821845 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lazy-loading 'fault' on Instance uuid 5b66be0c-5ad3-410b-94f2-74110dcffc9b {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:38:54.825512 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0f6c48a9-7a8c-4f88-8cbc-ca468986cda2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.173459 Jul 18 02:38:54.836088 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 286/566] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:54 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:54.870011 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:54.877712 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-71ef1236-fac4-4b2a-95fe-c43f35c7472c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 200 len: 1331 microversion: 2.1 time: 0.105637 Jul 18 02:38:54.878357 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 281/567] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:54 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:55.698397 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fb307e24-5e50-44c9-b721-fea261acd7ec tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:55.699618 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fb307e24-5e50-44c9-b721-fea261acd7ec tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:55.706696 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fb307e24-5e50-44c9-b721-fea261acd7ec tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.707346 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fb307e24-5e50-44c9-b721-fea261acd7ec tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.708249 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fb307e24-5e50-44c9-b721-fea261acd7ec tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.708694 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fb307e24-5e50-44c9-b721-fea261acd7ec tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.839691 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fb307e24-5e50-44c9-b721-fea261acd7ec tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:55.843308 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5cb278cb-7236-49f6-a063-6023818bec62 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:55.844267 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5cb278cb-7236-49f6-a063-6023818bec62 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:55.848485 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fb307e24-5e50-44c9-b721-fea261acd7ec tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:55.849983 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fb307e24-5e50-44c9-b721-fea261acd7ec tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:55.850670 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5cb278cb-7236-49f6-a063-6023818bec62 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.851116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5cb278cb-7236-49f6-a063-6023818bec62 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.851217 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fb307e24-5e50-44c9-b721-fea261acd7ec tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.156829 Jul 18 02:38:55.851750 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 287/568] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:55 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:38:55.851873 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5cb278cb-7236-49f6-a063-6023818bec62 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.852305 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5cb278cb-7236-49f6-a063-6023818bec62 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.896027 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2b365d3f-8a8b-4ddd-8e43-2ccfd5e65d80 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:55.896766 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2b365d3f-8a8b-4ddd-8e43-2ccfd5e65d80 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:55.902908 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2b365d3f-8a8b-4ddd-8e43-2ccfd5e65d80 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.903440 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2b365d3f-8a8b-4ddd-8e43-2ccfd5e65d80 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.904291 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2b365d3f-8a8b-4ddd-8e43-2ccfd5e65d80 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:55.904802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2b365d3f-8a8b-4ddd-8e43-2ccfd5e65d80 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:55.918708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-2b365d3f-8a8b-4ddd-8e43-2ccfd5e65d80 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2b365d3f-8a8b-4ddd-8e43-2ccfd5e65d80 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b HTTP/1.1 Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:38:55.920635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:38:55.922199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '5b66be0c-5ad3-410b-94f2-74110dcffc9b'} Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:38:55.922995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:38:55.925071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:38:55.926953 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2b365d3f-8a8b-4ddd-8e43-2ccfd5e65d80 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:38:55.926953 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2b365d3f-8a8b-4ddd-8e43-2ccfd5e65d80 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 404 len: 111 microversion: 2.1 time: 0.029844 Jul 18 02:38:55.926953 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 288/569] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:55 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:38:55.930725 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7112f7a6-8c73-42fd-b923-afbb72276c5c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '.version_select at 0x7f28ede16b80>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:55.988271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5cb278cb-7236-49f6-a063-6023818bec62 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:55.996477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5cb278cb-7236-49f6-a063-6023818bec62 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.156734 Jul 18 02:38:55.997184 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 282/570] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:55 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:38:56.005949 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7112f7a6-8c73-42fd-b923-afbb72276c5c tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-712848137" status: 202 len: 0 microversion: 2.1 time: 0.078740 Jul 18 02:38:56.006585 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 289/571] 10.222.0.66 () {58 vars in 1217 bytes} [Mon Jul 18 02:38:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-712848137 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:38:56.842975 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-20468d94-0863-42f4-bb3a-3fcc42479f82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:56.843583 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-20468d94-0863-42f4-bb3a-3fcc42479f82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:56.849962 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-20468d94-0863-42f4-bb3a-3fcc42479f82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.850369 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-20468d94-0863-42f4-bb3a-3fcc42479f82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.851333 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-20468d94-0863-42f4-bb3a-3fcc42479f82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.851924 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-20468d94-0863-42f4-bb3a-3fcc42479f82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.869938 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-90fe99a0-44c0-4d6d-b8d9-350d759d8e16 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:56.871178 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-90fe99a0-44c0-4d6d-b8d9-350d759d8e16 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:56.878550 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-90fe99a0-44c0-4d6d-b8d9-350d759d8e16 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.879205 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-90fe99a0-44c0-4d6d-b8d9-350d759d8e16 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.879760 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-90fe99a0-44c0-4d6d-b8d9-350d759d8e16 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:56.880222 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-90fe99a0-44c0-4d6d-b8d9-350d759d8e16 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:56.881992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:57.001657 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-20468d94-0863-42f4-bb3a-3fcc42479f82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lazy-loading 'services' on Instance uuid b883c80f-57dd-43cb-a44e-72b33a2128e9 {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:38:57.034156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-90fe99a0-44c0-4d6d-b8d9-350d759d8e16 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.045989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-90fe99a0-44c0-4d6d-b8d9-350d759d8e16 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.047617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-90fe99a0-44c0-4d6d-b8d9-350d759d8e16 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.048791 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-90fe99a0-44c0-4d6d-b8d9-350d759d8e16 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.183331 Jul 18 02:38:57.061942 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 290/572] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:56 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:57.061942 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cd2d7902-962e-444f-b1f3-5bd206ba30bc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:57.061942 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cd2d7902-962e-444f-b1f3-5bd206ba30bc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:57.067197 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd2d7902-962e-444f-b1f3-5bd206ba30bc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.067197 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd2d7902-962e-444f-b1f3-5bd206ba30bc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.067197 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd2d7902-962e-444f-b1f3-5bd206ba30bc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.067197 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd2d7902-962e-444f-b1f3-5bd206ba30bc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.212861 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cd2d7902-962e-444f-b1f3-5bd206ba30bc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:57.221884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cd2d7902-962e-444f-b1f3-5bd206ba30bc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.170385 Jul 18 02:38:57.222507 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 291/573] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:57 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:57.339851 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-20468d94-0863-42f4-bb3a-3fcc42479f82 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments/978c3dee-b101-4468-925c-6179bb0bcd2b" status: 202 len: 0 microversion: 2.1 time: 0.497856 Jul 18 02:38:57.339851 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 283/574] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:38:56 2022] DELETE /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments/978c3dee-b101-4468-925c-6179bb0bcd2b => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:38:57.344977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6ab64e9b-2a27-4bea-89a5-6097bb794922 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:57.345932 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6ab64e9b-2a27-4bea-89a5-6097bb794922 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:57.352482 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6ab64e9b-2a27-4bea-89a5-6097bb794922 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.352936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6ab64e9b-2a27-4bea-89a5-6097bb794922 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.353706 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6ab64e9b-2a27-4bea-89a5-6097bb794922 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:57.354166 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6ab64e9b-2a27-4bea-89a5-6097bb794922 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:57.386316 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6ab64e9b-2a27-4bea-89a5-6097bb794922 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Jul 18 02:38:57.386468 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 292/575] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:38:57 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:58.069847 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e1d4bc75-8b08-414b-b97a-a6d18385a4d3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:58.070563 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e1d4bc75-8b08-414b-b97a-a6d18385a4d3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:58.077588 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e1d4bc75-8b08-414b-b97a-a6d18385a4d3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.078040 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e1d4bc75-8b08-414b-b97a-a6d18385a4d3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.078838 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e1d4bc75-8b08-414b-b97a-a6d18385a4d3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.079275 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e1d4bc75-8b08-414b-b97a-a6d18385a4d3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.220621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e1d4bc75-8b08-414b-b97a-a6d18385a4d3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:58.229059 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e1d4bc75-8b08-414b-b97a-a6d18385a4d3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:58.230627 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e1d4bc75-8b08-414b-b97a-a6d18385a4d3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:58.231939 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e1d4bc75-8b08-414b-b97a-a6d18385a4d3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.166881 Jul 18 02:38:58.233201 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 284/576] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:58 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:58.239899 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6676e366-4acc-4916-971b-8e4b09f94e70 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:58.244841 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6676e366-4acc-4916-971b-8e4b09f94e70 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:58.247426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6676e366-4acc-4916-971b-8e4b09f94e70 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.247883 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6676e366-4acc-4916-971b-8e4b09f94e70 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.248655 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6676e366-4acc-4916-971b-8e4b09f94e70 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.249099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6676e366-4acc-4916-971b-8e4b09f94e70 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.399617 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-854e6417-d8cb-43c2-8e49-b8a1f0942835 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:58.401276 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-854e6417-d8cb-43c2-8e49-b8a1f0942835 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:58.409896 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-854e6417-d8cb-43c2-8e49-b8a1f0942835 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.414713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-854e6417-d8cb-43c2-8e49-b8a1f0942835 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.414713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-854e6417-d8cb-43c2-8e49-b8a1f0942835 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:58.414713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-854e6417-d8cb-43c2-8e49-b8a1f0942835 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:58.428221 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6676e366-4acc-4916-971b-8e4b09f94e70 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:58.438773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6676e366-4acc-4916-971b-8e4b09f94e70 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.202655 Jul 18 02:38:58.440450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 293/577] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:58 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:38:58.451286 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-854e6417-d8cb-43c2-8e49-b8a1f0942835 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057342 Jul 18 02:38:58.451856 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 285/578] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:38:58 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:38:59.251813 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9c25ecd4-91f7-420e-bbf5-d0192a37f9da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:59.252429 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9c25ecd4-91f7-420e-bbf5-d0192a37f9da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:59.259005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9c25ecd4-91f7-420e-bbf5-d0192a37f9da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:59.259490 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9c25ecd4-91f7-420e-bbf5-d0192a37f9da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:59.260273 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9c25ecd4-91f7-420e-bbf5-d0192a37f9da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:59.260857 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9c25ecd4-91f7-420e-bbf5-d0192a37f9da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:59.398192 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9c25ecd4-91f7-420e-bbf5-d0192a37f9da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:59.407577 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9c25ecd4-91f7-420e-bbf5-d0192a37f9da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:59.409071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9c25ecd4-91f7-420e-bbf5-d0192a37f9da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:59.410269 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9c25ecd4-91f7-420e-bbf5-d0192a37f9da tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1809 microversion: 2.20 time: 0.162617 Jul 18 02:38:59.410836 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 294/579] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:38:59 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:38:59.456190 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ec540561-b268-4447-aad7-feca1c9ce6e3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:59.456829 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ec540561-b268-4447-aad7-feca1c9ce6e3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:59.463668 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec540561-b268-4447-aad7-feca1c9ce6e3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:59.463849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f9fbaabe-71e6-4e9d-a1c0-db2ef3cc09a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:38:59.464125 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec540561-b268-4447-aad7-feca1c9ce6e3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:59.465516 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f9fbaabe-71e6-4e9d-a1c0-db2ef3cc09a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:38:59.465648 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec540561-b268-4447-aad7-feca1c9ce6e3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:59.466071 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec540561-b268-4447-aad7-feca1c9ce6e3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:59.473169 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9fbaabe-71e6-4e9d-a1c0-db2ef3cc09a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:59.473749 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9fbaabe-71e6-4e9d-a1c0-db2ef3cc09a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:59.474668 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9fbaabe-71e6-4e9d-a1c0-db2ef3cc09a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:38:59.475344 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f9fbaabe-71e6-4e9d-a1c0-db2ef3cc09a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:38:59.509524 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f9fbaabe-71e6-4e9d-a1c0-db2ef3cc09a1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049680 Jul 18 02:38:59.510478 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 295/580] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:38:59 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:38:59.602983 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ec540561-b268-4447-aad7-feca1c9ce6e3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:38:59.610622 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ec540561-b268-4447-aad7-feca1c9ce6e3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.158270 Jul 18 02:38:59.611201 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 286/581] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:38:59 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:00.429034 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bfe998ac-e72f-4bd9-a0fa-3e5222a58b8a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:00.429652 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bfe998ac-e72f-4bd9-a0fa-3e5222a58b8a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:00.436502 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bfe998ac-e72f-4bd9-a0fa-3e5222a58b8a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.436981 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bfe998ac-e72f-4bd9-a0fa-3e5222a58b8a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.437750 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bfe998ac-e72f-4bd9-a0fa-3e5222a58b8a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.438216 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bfe998ac-e72f-4bd9-a0fa-3e5222a58b8a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.520904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-605ee24d-fce6-4e4b-a51e-29c5ed9f5d3f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:00.521857 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-605ee24d-fce6-4e4b-a51e-29c5ed9f5d3f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:00.529476 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-605ee24d-fce6-4e4b-a51e-29c5ed9f5d3f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.530050 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-605ee24d-fce6-4e4b-a51e-29c5ed9f5d3f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.530861 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-605ee24d-fce6-4e4b-a51e-29c5ed9f5d3f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.531301 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-605ee24d-fce6-4e4b-a51e-29c5ed9f5d3f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.559631 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-605ee24d-fce6-4e4b-a51e-29c5ed9f5d3f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042547 Jul 18 02:39:00.560189 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 287/582] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:39:00 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:39:00.567317 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bfe998ac-e72f-4bd9-a0fa-3e5222a58b8a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.576463 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bfe998ac-e72f-4bd9-a0fa-3e5222a58b8a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.577955 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bfe998ac-e72f-4bd9-a0fa-3e5222a58b8a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.579170 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bfe998ac-e72f-4bd9-a0fa-3e5222a58b8a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1796 microversion: 2.20 time: 0.154332 Jul 18 02:39:00.579729 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 296/583] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:00 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1796 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:00.622439 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-616c6f8c-709a-4a36-b6ba-13ce49fc4ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:00.622923 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-616c6f8c-709a-4a36-b6ba-13ce49fc4ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:00.627166 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-526a0041-0af7-46fe-b7f8-870965943f14 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:00.627892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-526a0041-0af7-46fe-b7f8-870965943f14 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:00.628952 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-616c6f8c-709a-4a36-b6ba-13ce49fc4ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.629397 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-616c6f8c-709a-4a36-b6ba-13ce49fc4ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.630189 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-616c6f8c-709a-4a36-b6ba-13ce49fc4ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.630625 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-616c6f8c-709a-4a36-b6ba-13ce49fc4ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.633994 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-526a0041-0af7-46fe-b7f8-870965943f14 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.634625 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-526a0041-0af7-46fe-b7f8-870965943f14 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.635445 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-526a0041-0af7-46fe-b7f8-870965943f14 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:00.635917 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-526a0041-0af7-46fe-b7f8-870965943f14 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:00.655998 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-616c6f8c-709a-4a36-b6ba-13ce49fc4ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:39:00.766941 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-526a0041-0af7-46fe-b7f8-870965943f14 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:00.774535 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-526a0041-0af7-46fe-b7f8-870965943f14 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.151222 Jul 18 02:39:00.775105 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 297/584] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:00 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:01.014166 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-616c6f8c-709a-4a36-b6ba-13ce49fc4ab3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 204 len: 0 microversion: 2.1 time: 0.395737 Jul 18 02:39:01.014672 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 288/585] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:39:00 2022] DELETE /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:39:01.022844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-13be743f-9c81-4a5f-b15f-1a0c0792eac5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:01.023458 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-13be743f-9c81-4a5f-b15f-1a0c0792eac5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:01.029457 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-13be743f-9c81-4a5f-b15f-1a0c0792eac5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.029914 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-13be743f-9c81-4a5f-b15f-1a0c0792eac5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.030708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-13be743f-9c81-4a5f-b15f-1a0c0792eac5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.031142 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-13be743f-9c81-4a5f-b15f-1a0c0792eac5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.162710 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-13be743f-9c81-4a5f-b15f-1a0c0792eac5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:01.170704 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-13be743f-9c81-4a5f-b15f-1a0c0792eac5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1682 microversion: 2.1 time: 0.151708 Jul 18 02:39:01.171554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 298/586] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:01 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:01.792078 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7d4a1bd4-a56e-46c9-adea-d2e66e7118d1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:01.792808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7d4a1bd4-a56e-46c9-adea-d2e66e7118d1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:01.799849 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7d4a1bd4-a56e-46c9-adea-d2e66e7118d1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.800304 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7d4a1bd4-a56e-46c9-adea-d2e66e7118d1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.801067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7d4a1bd4-a56e-46c9-adea-d2e66e7118d1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:01.801507 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7d4a1bd4-a56e-46c9-adea-d2e66e7118d1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:01.933591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-7d4a1bd4-a56e-46c9-adea-d2e66e7118d1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:01.941815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7d4a1bd4-a56e-46c9-adea-d2e66e7118d1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.153930 Jul 18 02:39:01.942421 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 289/587] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:01 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:02.187921 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-625ad24b-efb2-444b-b78e-13e2e80a908a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:02.188528 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-625ad24b-efb2-444b-b78e-13e2e80a908a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:02.195027 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-625ad24b-efb2-444b-b78e-13e2e80a908a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:02.195478 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-625ad24b-efb2-444b-b78e-13e2e80a908a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:02.196230 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-625ad24b-efb2-444b-b78e-13e2e80a908a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:02.196667 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-625ad24b-efb2-444b-b78e-13e2e80a908a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:02.323735 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-625ad24b-efb2-444b-b78e-13e2e80a908a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:02.331201 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-625ad24b-efb2-444b-b78e-13e2e80a908a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1682 microversion: 2.1 time: 0.147124 Jul 18 02:39:02.331765 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 299/588] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:02 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:02.958905 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f5574185-be53-478a-b0f4-2d910c2d4dd7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:02.959837 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f5574185-be53-478a-b0f4-2d910c2d4dd7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:02.966302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f5574185-be53-478a-b0f4-2d910c2d4dd7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:02.966754 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f5574185-be53-478a-b0f4-2d910c2d4dd7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:02.967509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f5574185-be53-478a-b0f4-2d910c2d4dd7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:02.967946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f5574185-be53-478a-b0f4-2d910c2d4dd7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:03.103670 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f5574185-be53-478a-b0f4-2d910c2d4dd7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:03.112054 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f5574185-be53-478a-b0f4-2d910c2d4dd7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.157149 Jul 18 02:39:03.112660 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 290/589] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:02 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:03.348859 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0a76127f-2f5a-4a3c-a18f-7d5e5d741c3d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:03.350189 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0a76127f-2f5a-4a3c-a18f-7d5e5d741c3d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:03.357049 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a76127f-2f5a-4a3c-a18f-7d5e5d741c3d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:03.357709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a76127f-2f5a-4a3c-a18f-7d5e5d741c3d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:03.358801 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a76127f-2f5a-4a3c-a18f-7d5e5d741c3d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:03.359238 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a76127f-2f5a-4a3c-a18f-7d5e5d741c3d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:03.414797 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-eff762f9-c9e1-45fb-912c-4a3491693f33 req-b7b277ea-49bf-45e4-8f7d-81a089b0c5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7697d1-40ec-4c17-979a-de45d737eac5", "name": "network-vif-plugged", "status": "completed", "tag": "3ff30934-3b2b-494c-bbcf-58c1f9f9094e"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:03.425512 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-eff762f9-c9e1-45fb-912c-4a3491693f33 req-b7b277ea-49bf-45e4-8f7d-81a089b0c5ce service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:03.426385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-eff762f9-c9e1-45fb-912c-4a3491693f33 req-b7b277ea-49bf-45e4-8f7d-81a089b0c5ce service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:03.438079 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-eff762f9-c9e1-45fb-912c-4a3491693f33 req-b7b277ea-49bf-45e4-8f7d-81a089b0c5ce service nova] Creating event network-vif-plugged:3ff30934-3b2b-494c-bbcf-58c1f9f9094e for instance fb7697d1-40ec-4c17-979a-de45d737eac5 on hv-cinder-85001 Jul 18 02:39:03.443140 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-eff762f9-c9e1-45fb-912c-4a3491693f33 req-b7b277ea-49bf-45e4-8f7d-81a089b0c5ce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032203 Jul 18 02:39:03.444012 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 291/590] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:39:03.508248 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0a76127f-2f5a-4a3c-a18f-7d5e5d741c3d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:03.516442 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0a76127f-2f5a-4a3c-a18f-7d5e5d741c3d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1682 microversion: 2.1 time: 0.171336 Jul 18 02:39:03.517939 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 300/591] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:03 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:04.130059 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-50494e55-3591-498c-9e44-5fe6bd2e1b00 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:04.130783 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-50494e55-3591-498c-9e44-5fe6bd2e1b00 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:04.137544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-50494e55-3591-498c-9e44-5fe6bd2e1b00 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.138405 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-50494e55-3591-498c-9e44-5fe6bd2e1b00 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.139135 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-50494e55-3591-498c-9e44-5fe6bd2e1b00 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.139605 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-50494e55-3591-498c-9e44-5fe6bd2e1b00 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.344182 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-d3b8c45d-287d-404b-9891-f31df47259b7 req-942eab69-95cf-4e27-9b31-40a3ef0c06b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b883c80f-57dd-43cb-a44e-72b33a2128e9", "name": "network-vif-deleted", "tag": "063ebb17-b759-41b1-bb29-1214343746a1"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:04.353341 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-d3b8c45d-287d-404b-9891-f31df47259b7 req-942eab69-95cf-4e27-9b31-40a3ef0c06b5 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.354785 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-d3b8c45d-287d-404b-9891-f31df47259b7 req-942eab69-95cf-4e27-9b31-40a3ef0c06b5 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.367007 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-50494e55-3591-498c-9e44-5fe6bd2e1b00 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:04.372053 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-d3b8c45d-287d-404b-9891-f31df47259b7 req-942eab69-95cf-4e27-9b31-40a3ef0c06b5 service nova] Creating event network-vif-deleted:063ebb17-b759-41b1-bb29-1214343746a1 for instance b883c80f-57dd-43cb-a44e-72b33a2128e9 on hv-cinder-85001 Jul 18 02:39:04.375145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-50494e55-3591-498c-9e44-5fe6bd2e1b00 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.249942 Jul 18 02:39:04.378896 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-d3b8c45d-287d-404b-9891-f31df47259b7 req-942eab69-95cf-4e27-9b31-40a3ef0c06b5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041729 Jul 18 02:39:04.380733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 301/592] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:04.385012 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 292/593] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:04 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:04.535506 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-34392e46-a3ed-4fa3-be3a-76c2cba84891 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:04.536241 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-34392e46-a3ed-4fa3-be3a-76c2cba84891 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:04.542774 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34392e46-a3ed-4fa3-be3a-76c2cba84891 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.543840 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34392e46-a3ed-4fa3-be3a-76c2cba84891 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.544630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34392e46-a3ed-4fa3-be3a-76c2cba84891 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:04.545059 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34392e46-a3ed-4fa3-be3a-76c2cba84891 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:04.610904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-34392e46-a3ed-4fa3-be3a-76c2cba84891 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:04.618364 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-34392e46-a3ed-4fa3-be3a-76c2cba84891 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1614 microversion: 2.1 time: 0.087129 Jul 18 02:39:04.618936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 302/594] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:04 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:05.391757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ec20db78-afdf-4975-aa0d-020d77bef2e6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:05.392374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ec20db78-afdf-4975-aa0d-020d77bef2e6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:05.399348 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec20db78-afdf-4975-aa0d-020d77bef2e6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.399808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec20db78-afdf-4975-aa0d-020d77bef2e6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.400581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec20db78-afdf-4975-aa0d-020d77bef2e6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.401024 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec20db78-afdf-4975-aa0d-020d77bef2e6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.537598 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ec20db78-afdf-4975-aa0d-020d77bef2e6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:05.545503 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ec20db78-afdf-4975-aa0d-020d77bef2e6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1265 microversion: 2.1 time: 0.157699 Jul 18 02:39:05.546064 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 293/595] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:05 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:05.635444 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:05.635989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:05.642721 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.643174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.643963 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.644397 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.675348 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.675798 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.676246 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lazy-loading 'fault' on Instance uuid b883c80f-57dd-43cb-a44e-72b33a2128e9 {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:05.698809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-92a9fcd9-f7c0-4fe2-b8df-37b44908d560 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:05.699300 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-92a9fcd9-f7c0-4fe2-b8df-37b44908d560 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:05.705509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-92a9fcd9-f7c0-4fe2-b8df-37b44908d560 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.705957 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-92a9fcd9-f7c0-4fe2-b8df-37b44908d560 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.706767 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-92a9fcd9-f7c0-4fe2-b8df-37b44908d560 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:05.707205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-92a9fcd9-f7c0-4fe2-b8df-37b44908d560 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:05.717182 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:05.724295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-93e03c80-0e85-4d57-9390-d12889a15e66 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1331 microversion: 2.1 time: 0.092668 Jul 18 02:39:05.724876 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 303/596] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:05 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:05.786236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-92a9fcd9-f7c0-4fe2-b8df-37b44908d560 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lazy-loading 'services' on Instance uuid 6e1905a0-2c49-40f1-921a-0fda9997cdb3 {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:06.007682 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-92a9fcd9-f7c0-4fe2-b8df-37b44908d560 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/os-volume_attachments/ed127def-76ea-4eaf-971f-23fba617f0f6" status: 202 len: 0 microversion: 2.1 time: 0.312601 Jul 18 02:39:06.008276 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 294/597] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:39:05 2022] DELETE /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/os-volume_attachments/ed127def-76ea-4eaf-971f-23fba617f0f6 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:39:06.562879 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b5ae636c-cd25-4a55-ae69-bf69c06076cc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:06.563490 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b5ae636c-cd25-4a55-ae69-bf69c06076cc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:06.565489 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:06.570215 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b5ae636c-cd25-4a55-ae69-bf69c06076cc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.570666 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b5ae636c-cd25-4a55-ae69-bf69c06076cc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.571426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b5ae636c-cd25-4a55-ae69-bf69c06076cc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.571863 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b5ae636c-cd25-4a55-ae69-bf69c06076cc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.725097 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b5ae636c-cd25-4a55-ae69-bf69c06076cc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:06.728602 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:06.733235 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b5ae636c-cd25-4a55-ae69-bf69c06076cc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1452 microversion: 2.1 time: 0.174983 Jul 18 02:39:06.733798 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 304/598] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:06 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:06.745897 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:06.745897 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:06.752810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cad8a467-f672-491e-96f0-5ec4f391d163 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:06.753306 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.753416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cad8a467-f672-491e-96f0-5ec4f391d163 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:06.754017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.754909 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.755353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.760003 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cad8a467-f672-491e-96f0-5ec4f391d163 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.760460 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cad8a467-f672-491e-96f0-5ec4f391d163 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.761314 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cad8a467-f672-491e-96f0-5ec4f391d163 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.761771 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cad8a467-f672-491e-96f0-5ec4f391d163 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.792499 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:06.792871 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:06.793326 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lazy-loading 'fault' on Instance uuid b883c80f-57dd-43cb-a44e-72b33a2128e9 {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:06.839389 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:06.847636 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6af924ff-17e0-4cbd-9ddf-91fc41aed8ec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 200 len: 1331 microversion: 2.1 time: 0.109983 Jul 18 02:39:06.848214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 295/599] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:06 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:06.896014 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cad8a467-f672-491e-96f0-5ec4f391d163 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:06.903364 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cad8a467-f672-491e-96f0-5ec4f391d163 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1452 microversion: 2.1 time: 0.154536 Jul 18 02:39:06.903940 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 305/600] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:06 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:07.876303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c941c456-cecf-4b78-8068-36f38e6643ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:07.876303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c941c456-cecf-4b78-8068-36f38e6643ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:07.876303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c941c456-cecf-4b78-8068-36f38e6643ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:07.876303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c941c456-cecf-4b78-8068-36f38e6643ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:07.877169 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c941c456-cecf-4b78-8068-36f38e6643ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:07.877169 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c941c456-cecf-4b78-8068-36f38e6643ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:07.887644 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-c941c456-cecf-4b78-8068-36f38e6643ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c941c456-cecf-4b78-8068-36f38e6643ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 HTTP/1.1 Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:39:07.889946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:39:07.891628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': 'b883c80f-57dd-43cb-a44e-72b33a2128e9'} Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:07.892516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:39:07.894026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:07.895340 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c941c456-cecf-4b78-8068-36f38e6643ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:07.895340 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c941c456-cecf-4b78-8068-36f38e6643ab tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 404 len: 111 microversion: 2.1 time: 0.030542 Jul 18 02:39:07.895340 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 296/601] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:07 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:07.900566 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bb3d36f4-6593-47c6-b0bd-c397c1ae22f4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '.version_select at 0x7f28ede04280>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:08.084635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bb3d36f4-6593-47c6-b0bd-c397c1ae22f4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467427019" status: 202 len: 0 microversion: 2.1 time: 0.188048 Jul 18 02:39:08.085381 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 306/602] 10.222.0.66 () {58 vars in 1220 bytes} [Mon Jul 18 02:39:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467427019 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:39:08.193067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0d10041e-4201-44a3-87b4-ebfbec06c8ab tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:08.199446 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0d10041e-4201-44a3-87b4-ebfbec06c8ab tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.200252 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0d10041e-4201-44a3-87b4-ebfbec06c8ab tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.225933 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0d10041e-4201-44a3-87b4-ebfbec06c8ab tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Going to try to stop instance {{(pid=124891) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 02:39:08.229475 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:08.541898 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0d10041e-4201-44a3-87b4-ebfbec06c8ab tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/action" status: 202 len: 0 microversion: 2.1 time: 0.352467 Jul 18 02:39:08.542533 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 297/603] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:08 2022] POST /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:39:08.552157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-73d4ecd7-7fff-45a9-b3a4-b74d2f0629c2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:08.552880 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-73d4ecd7-7fff-45a9-b3a4-b74d2f0629c2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:08.559705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-73d4ecd7-7fff-45a9-b3a4-b74d2f0629c2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.560226 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-73d4ecd7-7fff-45a9-b3a4-b74d2f0629c2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.562033 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-73d4ecd7-7fff-45a9-b3a4-b74d2f0629c2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:08.562531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-73d4ecd7-7fff-45a9-b3a4-b74d2f0629c2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:08.792285 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-73d4ecd7-7fff-45a9-b3a4-b74d2f0629c2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:08.801718 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-73d4ecd7-7fff-45a9-b3a4-b74d2f0629c2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.253788 Jul 18 02:39:08.813131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 307/604] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:08 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:09.121065 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1e0c0633-b60d-4442-877b-db813379c558 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: .version_select at 0x7f28ee5c6160>, body: {"keypair": {"name": "tempest-keypair-519827577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWdcdBmDSAxgkUdjJor1qg8X7J/BUa9kuSmzGx/EB0Q0TDGLP18Uk5yi8c5BCjYDLgo39PGUWYBZeAeT06g3yoa73AsBOK2ZwlFnLURcK6N0Dmabm/rf7SEswBtI9wPNQ=="}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:09.135937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-1e0c0633-b60d-4442-877b-db813379c558 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'key_pairs'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:39:09.139849 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-1e0c0633-b60d-4442-877b-db813379c558 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for user 94c16391d39f4498a55c89bf2838788f and project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'key_pairs'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:39:09.296647 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1e0c0633-b60d-4442-877b-db813379c558 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180041 Jul 18 02:39:09.297508 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 298/605] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 18 02:39:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:09.821065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a5c76122-d2e0-4b9c-8333-33acdbeb34e1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:09.822570 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a5c76122-d2e0-4b9c-8333-33acdbeb34e1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:09.829936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a5c76122-d2e0-4b9c-8333-33acdbeb34e1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.830487 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a5c76122-d2e0-4b9c-8333-33acdbeb34e1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:09.837247 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a5c76122-d2e0-4b9c-8333-33acdbeb34e1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.837247 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a5c76122-d2e0-4b9c-8333-33acdbeb34e1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:09.868892 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-509c9756-0d25-4b47-be00-3ba14aea66ba req-e30462db-3917-4f2b-967a-900623aabaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7697d1-40ec-4c17-979a-de45d737eac5", "tag": "3ff30934-3b2b-494c-bbcf-58c1f9f9094e"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:09.878506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-509c9756-0d25-4b47-be00-3ba14aea66ba req-e30462db-3917-4f2b-967a-900623aabaf2 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:09.878960 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-509c9756-0d25-4b47-be00-3ba14aea66ba req-e30462db-3917-4f2b-967a-900623aabaf2 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:09.892972 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-509c9756-0d25-4b47-be00-3ba14aea66ba req-e30462db-3917-4f2b-967a-900623aabaf2 service nova] Creating event network-changed:3ff30934-3b2b-494c-bbcf-58c1f9f9094e for instance fb7697d1-40ec-4c17-979a-de45d737eac5 on hv-cinder-85001 Jul 18 02:39:09.898219 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-509c9756-0d25-4b47-be00-3ba14aea66ba req-e30462db-3917-4f2b-967a-900623aabaf2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033308 Jul 18 02:39:09.899000 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 299/606] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:09.971794 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a5c76122-d2e0-4b9c-8333-33acdbeb34e1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:09.981378 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a5c76122-d2e0-4b9c-8333-33acdbeb34e1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.164141 Jul 18 02:39:09.983238 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 308/607] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:09 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:11.000145 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f59f0a0d-6648-4e11-8143-32aec1ef6b2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:11.000866 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f59f0a0d-6648-4e11-8143-32aec1ef6b2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:11.008978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f59f0a0d-6648-4e11-8143-32aec1ef6b2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.009425 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f59f0a0d-6648-4e11-8143-32aec1ef6b2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.010214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f59f0a0d-6648-4e11-8143-32aec1ef6b2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:11.010647 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f59f0a0d-6648-4e11-8143-32aec1ef6b2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:11.148939 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f59f0a0d-6648-4e11-8143-32aec1ef6b2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:11.156955 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f59f0a0d-6648-4e11-8143-32aec1ef6b2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.160937 Jul 18 02:39:11.157521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 300/608] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:10 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:12.054790 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-450959771", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdc6ffcf-95a1-4f66-b96c-1c077c87b2a3"}], "security_groups": [{"name": "tempest-securitygroup--1525418456"}], "key_name": "tempest-keypair-519827577", "user_data": "}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:12.158847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.network.neutron [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] validate_networks() for [('cdc6ffcf-95a1-4f66-b96c-1c077c87b2a3', None, None, None, None, None)] {{(pid=124890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:39:12.175303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5a834703-4f76-4ef1-856d-4bc314c04973 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:12.176760 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5a834703-4f76-4ef1-856d-4bc314c04973 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:12.183128 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5a834703-4f76-4ef1-856d-4bc314c04973 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:12.183577 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5a834703-4f76-4ef1-856d-4bc314c04973 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:12.184340 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5a834703-4f76-4ef1-856d-4bc314c04973 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:12.184769 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5a834703-4f76-4ef1-856d-4bc314c04973 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:12.315265 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5a834703-4f76-4ef1-856d-4bc314c04973 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:12.322702 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5a834703-4f76-4ef1-856d-4bc314c04973 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.152215 Jul 18 02:39:12.323273 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 301/609] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:12 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:12.527775 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Flavor limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:39:12.528210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Image limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:39:12.528736 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Flavor pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:39:12.529151 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Image pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:39:12.530311 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:39:12.539724 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:12.540173 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:12.540972 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:12.541408 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:12.558293 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:39:12.562857 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for user 94c16391d39f4498a55c89bf2838788f and project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:39:12.573661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Going to run 1 instances... {{(pid=124890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:39:12.575949 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:39:12.682878 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-da418ca3-da7b-4292-bfd3-814061080350 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.632397 Jul 18 02:39:12.683451 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 309/610] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:39:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:39:12.694439 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5eb5359e-e9aa-415c-8389-ad032b9c9908 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:12.695052 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5eb5359e-e9aa-415c-8389-ad032b9c9908 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:12.749507 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5eb5359e-e9aa-415c-8389-ad032b9c9908 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:12.756327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5eb5359e-e9aa-415c-8389-ad032b9c9908 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1240 microversion: 2.1 time: 0.065676 Jul 18 02:39:12.756922 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 302/611] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:12 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:13.340717 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-249dfccd-6675-441c-9f8b-3759d93a2a8b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:13.341349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-249dfccd-6675-441c-9f8b-3759d93a2a8b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:13.348176 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-249dfccd-6675-441c-9f8b-3759d93a2a8b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:13.348622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-249dfccd-6675-441c-9f8b-3759d93a2a8b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:13.349387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-249dfccd-6675-441c-9f8b-3759d93a2a8b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:13.349816 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-249dfccd-6675-441c-9f8b-3759d93a2a8b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:13.489698 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-249dfccd-6675-441c-9f8b-3759d93a2a8b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:13.497219 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-249dfccd-6675-441c-9f8b-3759d93a2a8b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.160867 Jul 18 02:39:13.497790 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 310/612] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:13 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:13.774940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5f230686-e587-4d9e-b517-10c49e3055cf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:13.775534 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5f230686-e587-4d9e-b517-10c49e3055cf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:13.782410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f230686-e587-4d9e-b517-10c49e3055cf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:13.782857 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f230686-e587-4d9e-b517-10c49e3055cf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:13.783626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f230686-e587-4d9e-b517-10c49e3055cf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:13.784060 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f230686-e587-4d9e-b517-10c49e3055cf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:13.849260 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5f230686-e587-4d9e-b517-10c49e3055cf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:13.857155 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5f230686-e587-4d9e-b517-10c49e3055cf tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1244 microversion: 2.1 time: 0.086783 Jul 18 02:39:13.858315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 303/613] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:13 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:14.515383 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8855b0f8-bb44-4402-adf8-66f2b6d4b543 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:14.515991 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8855b0f8-bb44-4402-adf8-66f2b6d4b543 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:14.522528 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8855b0f8-bb44-4402-adf8-66f2b6d4b543 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.522976 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8855b0f8-bb44-4402-adf8-66f2b6d4b543 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.523737 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8855b0f8-bb44-4402-adf8-66f2b6d4b543 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.524173 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8855b0f8-bb44-4402-adf8-66f2b6d4b543 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.657614 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8855b0f8-bb44-4402-adf8-66f2b6d4b543 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:14.665202 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8855b0f8-bb44-4402-adf8-66f2b6d4b543 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.154579 Jul 18 02:39:14.665770 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 311/614] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:14 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:14.688788 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3f3792fd-1f12-4cba-98cb-51b09f373bb7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d65dbf55-24f0-4fa1-95f8-768138d5c0f4"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:14.696373 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3f3792fd-1f12-4cba-98cb-51b09f373bb7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:14.696373 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f3792fd-1f12-4cba-98cb-51b09f373bb7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.696373 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f3792fd-1f12-4cba-98cb-51b09f373bb7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.697113 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f3792fd-1f12-4cba-98cb-51b09f373bb7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.697542 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f3792fd-1f12-4cba-98cb-51b09f373bb7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.875025 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f1805ab0-cc7e-4068-b188-7c5c8c3e88ae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:14.875643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f1805ab0-cc7e-4068-b188-7c5c8c3e88ae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:14.881912 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f1805ab0-cc7e-4068-b188-7c5c8c3e88ae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.882391 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f1805ab0-cc7e-4068-b188-7c5c8c3e88ae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.883169 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f1805ab0-cc7e-4068-b188-7c5c8c3e88ae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:14.883599 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f1805ab0-cc7e-4068-b188-7c5c8c3e88ae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:14.944678 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f1805ab0-cc7e-4068-b188-7c5c8c3e88ae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:14.952572 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f1805ab0-cc7e-4068-b188-7c5c8c3e88ae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1292 microversion: 2.1 time: 0.081748 Jul 18 02:39:14.953352 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 312/615] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:14 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:15.682171 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cbf90aa1-8345-48e0-bdcd-c1bb7d2a68f4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:15.682867 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cbf90aa1-8345-48e0-bdcd-c1bb7d2a68f4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:15.690056 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cbf90aa1-8345-48e0-bdcd-c1bb7d2a68f4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:15.690544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cbf90aa1-8345-48e0-bdcd-c1bb7d2a68f4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:15.691320 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cbf90aa1-8345-48e0-bdcd-c1bb7d2a68f4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:15.691761 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cbf90aa1-8345-48e0-bdcd-c1bb7d2a68f4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:15.785076 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3f3792fd-1f12-4cba-98cb-51b09f373bb7 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.100031 Jul 18 02:39:15.786300 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 304/616] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:39:14 2022] POST /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments => generated 194 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:15.835562 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cbf90aa1-8345-48e0-bdcd-c1bb7d2a68f4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:15.843329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cbf90aa1-8345-48e0-bdcd-c1bb7d2a68f4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.165163 Jul 18 02:39:15.843889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 313/617] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:15 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:15.969886 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c03aba30-74b6-44ac-ab39-a502fd5ffeae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:15.970606 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c03aba30-74b6-44ac-ab39-a502fd5ffeae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:15.976976 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c03aba30-74b6-44ac-ab39-a502fd5ffeae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:15.977433 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c03aba30-74b6-44ac-ab39-a502fd5ffeae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:15.978227 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c03aba30-74b6-44ac-ab39-a502fd5ffeae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:15.978882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c03aba30-74b6-44ac-ab39-a502fd5ffeae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:16.217677 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c03aba30-74b6-44ac-ab39-a502fd5ffeae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:16.225417 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c03aba30-74b6-44ac-ab39-a502fd5ffeae tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1366 microversion: 2.1 time: 0.260023 Jul 18 02:39:16.226154 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 305/618] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:15 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:16.864084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1780647e-bc1d-4050-a35b-e068abe4e198 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:16.864084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1780647e-bc1d-4050-a35b-e068abe4e198 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:16.868579 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1780647e-bc1d-4050-a35b-e068abe4e198 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:16.869027 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1780647e-bc1d-4050-a35b-e068abe4e198 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:16.870005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1780647e-bc1d-4050-a35b-e068abe4e198 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:16.870878 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1780647e-bc1d-4050-a35b-e068abe4e198 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.018075 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1780647e-bc1d-4050-a35b-e068abe4e198 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:17.029336 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1780647e-bc1d-4050-a35b-e068abe4e198 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.172852 Jul 18 02:39:17.032477 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 314/619] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:16 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:17.209661 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-e1358bc6-ca1e-4f0a-aa4b-8a5ecc08b818 req-49bc99ae-6dbe-4429-a408-117ebb5a46d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5530cea9-7344-405e-bf59-9d4f629dddbc", "tag": "83d3e4fd-d88a-4c8f-85f4-86112f998a96"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:17.222256 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-e1358bc6-ca1e-4f0a-aa4b-8a5ecc08b818 req-49bc99ae-6dbe-4429-a408-117ebb5a46d8 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.223009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-e1358bc6-ca1e-4f0a-aa4b-8a5ecc08b818 req-49bc99ae-6dbe-4429-a408-117ebb5a46d8 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.239920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-e1358bc6-ca1e-4f0a-aa4b-8a5ecc08b818 req-49bc99ae-6dbe-4429-a408-117ebb5a46d8 service nova] Creating event network-changed:83d3e4fd-d88a-4c8f-85f4-86112f998a96 for instance 5530cea9-7344-405e-bf59-9d4f629dddbc on hv-cinder-85001 Jul 18 02:39:17.242286 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-75238f9e-13f9-481a-bdb8-e0aef52eb4e4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:17.243131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-75238f9e-13f9-481a-bdb8-e0aef52eb4e4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:17.244964 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-e1358bc6-ca1e-4f0a-aa4b-8a5ecc08b818 req-49bc99ae-6dbe-4429-a408-117ebb5a46d8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041758 Jul 18 02:39:17.245569 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 306/620] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:17.249701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75238f9e-13f9-481a-bdb8-e0aef52eb4e4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.250227 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75238f9e-13f9-481a-bdb8-e0aef52eb4e4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.251006 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75238f9e-13f9-481a-bdb8-e0aef52eb4e4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:17.251449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-75238f9e-13f9-481a-bdb8-e0aef52eb4e4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:17.387150 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-75238f9e-13f9-481a-bdb8-e0aef52eb4e4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:17.394787 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-75238f9e-13f9-481a-bdb8-e0aef52eb4e4 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1366 microversion: 2.1 time: 0.156472 Jul 18 02:39:17.395370 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 315/621] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:17 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:18.047171 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-41b6ad87-b8fe-4299-a1ba-08d1f95319f9 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:18.048163 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-41b6ad87-b8fe-4299-a1ba-08d1f95319f9 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:18.054485 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41b6ad87-b8fe-4299-a1ba-08d1f95319f9 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.055614 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41b6ad87-b8fe-4299-a1ba-08d1f95319f9 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.055738 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41b6ad87-b8fe-4299-a1ba-08d1f95319f9 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.056181 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-41b6ad87-b8fe-4299-a1ba-08d1f95319f9 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.191068 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-41b6ad87-b8fe-4299-a1ba-08d1f95319f9 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:18.198451 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-41b6ad87-b8fe-4299-a1ba-08d1f95319f9 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.155653 Jul 18 02:39:18.199014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 307/622] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:18 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:18.412105 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e0b0add0-1b67-4a6c-8757-70aae044732d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:18.412716 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e0b0add0-1b67-4a6c-8757-70aae044732d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:18.419265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e0b0add0-1b67-4a6c-8757-70aae044732d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.419714 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e0b0add0-1b67-4a6c-8757-70aae044732d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.420479 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e0b0add0-1b67-4a6c-8757-70aae044732d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:18.421034 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e0b0add0-1b67-4a6c-8757-70aae044732d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:18.552754 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e0b0add0-1b67-4a6c-8757-70aae044732d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:18.560701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e0b0add0-1b67-4a6c-8757-70aae044732d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1366 microversion: 2.1 time: 0.152426 Jul 18 02:39:18.561781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 316/623] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:18 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:19.215024 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ebc61b1a-3e54-4a06-af61-27f2ce85b210 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:19.215637 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ebc61b1a-3e54-4a06-af61-27f2ce85b210 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:19.222436 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ebc61b1a-3e54-4a06-af61-27f2ce85b210 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.222886 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ebc61b1a-3e54-4a06-af61-27f2ce85b210 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.223657 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ebc61b1a-3e54-4a06-af61-27f2ce85b210 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.224224 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ebc61b1a-3e54-4a06-af61-27f2ce85b210 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.354305 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ebc61b1a-3e54-4a06-af61-27f2ce85b210 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:19.362870 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ebc61b1a-3e54-4a06-af61-27f2ce85b210 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.151622 Jul 18 02:39:19.363446 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 308/624] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:19 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:19.577125 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-25e2f937-62a1-4e34-8dc9-30eaa7de8b9f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:19.577753 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-25e2f937-62a1-4e34-8dc9-30eaa7de8b9f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:19.584140 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-25e2f937-62a1-4e34-8dc9-30eaa7de8b9f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.584645 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-25e2f937-62a1-4e34-8dc9-30eaa7de8b9f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.585465 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-25e2f937-62a1-4e34-8dc9-30eaa7de8b9f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:19.585930 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-25e2f937-62a1-4e34-8dc9-30eaa7de8b9f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:19.716458 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-25e2f937-62a1-4e34-8dc9-30eaa7de8b9f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:19.724611 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-25e2f937-62a1-4e34-8dc9-30eaa7de8b9f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1366 microversion: 2.1 time: 0.151672 Jul 18 02:39:19.725306 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 317/625] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:19 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:20.380818 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0f542223-8241-483f-b760-92d3cd7923e8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:20.381447 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0f542223-8241-483f-b760-92d3cd7923e8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:20.387903 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0f542223-8241-483f-b760-92d3cd7923e8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.388348 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0f542223-8241-483f-b760-92d3cd7923e8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.389127 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0f542223-8241-483f-b760-92d3cd7923e8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.390257 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0f542223-8241-483f-b760-92d3cd7923e8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.520364 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0f542223-8241-483f-b760-92d3cd7923e8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.528101 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0f542223-8241-483f-b760-92d3cd7923e8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.151070 Jul 18 02:39:20.528729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 309/626] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:20 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:20.741318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-284f319b-dd3d-48ec-9568-5226bdad2eb8 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:20.741934 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-284f319b-dd3d-48ec-9568-5226bdad2eb8 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:20.748404 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-284f319b-dd3d-48ec-9568-5226bdad2eb8 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.749505 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-284f319b-dd3d-48ec-9568-5226bdad2eb8 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.750306 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-284f319b-dd3d-48ec-9568-5226bdad2eb8 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:20.750771 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-284f319b-dd3d-48ec-9568-5226bdad2eb8 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:20.880463 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-284f319b-dd3d-48ec-9568-5226bdad2eb8 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:20.887917 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-284f319b-dd3d-48ec-9568-5226bdad2eb8 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1366 microversion: 2.1 time: 0.150453 Jul 18 02:39:20.888485 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 318/627] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:20 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:21.544410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-85abf5bd-4444-4f8f-a3f5-aedff9d43178 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:21.544992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-85abf5bd-4444-4f8f-a3f5-aedff9d43178 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:21.552273 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-85abf5bd-4444-4f8f-a3f5-aedff9d43178 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.552728 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-85abf5bd-4444-4f8f-a3f5-aedff9d43178 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:21.553533 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-85abf5bd-4444-4f8f-a3f5-aedff9d43178 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.553972 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-85abf5bd-4444-4f8f-a3f5-aedff9d43178 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:21.687501 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-85abf5bd-4444-4f8f-a3f5-aedff9d43178 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:21.694945 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-85abf5bd-4444-4f8f-a3f5-aedff9d43178 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.154417 Jul 18 02:39:21.695512 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 310/628] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:21 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:21.904750 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5bc613d4-ff98-458f-ac78-68b1e887534b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:21.905947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-5bc613d4-ff98-458f-ac78-68b1e887534b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:21.912400 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5bc613d4-ff98-458f-ac78-68b1e887534b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.912848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5bc613d4-ff98-458f-ac78-68b1e887534b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:21.913612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5bc613d4-ff98-458f-ac78-68b1e887534b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:21.914047 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5bc613d4-ff98-458f-ac78-68b1e887534b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:22.046293 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5bc613d4-ff98-458f-ac78-68b1e887534b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:22.054569 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5bc613d4-ff98-458f-ac78-68b1e887534b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1366 microversion: 2.1 time: 0.153592 Jul 18 02:39:22.055256 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 319/629] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:21 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:22.712218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b6939abd-db58-4a25-b40d-895f0a133177 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:22.712857 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b6939abd-db58-4a25-b40d-895f0a133177 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:22.715330 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:22.720774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6939abd-db58-4a25-b40d-895f0a133177 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:22.721260 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6939abd-db58-4a25-b40d-895f0a133177 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:22.722121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6939abd-db58-4a25-b40d-895f0a133177 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:22.722559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6939abd-db58-4a25-b40d-895f0a133177 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:22.753324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=6 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:22.855386 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b6939abd-db58-4a25-b40d-895f0a133177 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:22.863067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b6939abd-db58-4a25-b40d-895f0a133177 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.154665 Jul 18 02:39:22.863570 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 311/630] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:22 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:23.072217 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-07582766-8513-4315-ac06-f0cd87ae88ce tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:23.072889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-07582766-8513-4315-ac06-f0cd87ae88ce tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:23.074756 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:23.075428 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=6 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:23.081416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-07582766-8513-4315-ac06-f0cd87ae88ce tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:23.081876 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-07582766-8513-4315-ac06-f0cd87ae88ce tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:23.082715 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-07582766-8513-4315-ac06-f0cd87ae88ce tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:23.083156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-07582766-8513-4315-ac06-f0cd87ae88ce tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:23.216965 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-07582766-8513-4315-ac06-f0cd87ae88ce tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:23.224459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-07582766-8513-4315-ac06-f0cd87ae88ce tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1366 microversion: 2.1 time: 0.156201 Jul 18 02:39:23.230248 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 320/631] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:23 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:23.527822 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-9f2e615d-4d01-4fe0-92e4-32ce452daecc req-d1486929-0cb8-42c9-9c93-53f3b5d15956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5530cea9-7344-405e-bf59-9d4f629dddbc", "name": "network-vif-plugged", "status": "completed", "tag": "83d3e4fd-d88a-4c8f-85f4-86112f998a96"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:23.537807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-9f2e615d-4d01-4fe0-92e4-32ce452daecc req-d1486929-0cb8-42c9-9c93-53f3b5d15956 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:23.538328 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-9f2e615d-4d01-4fe0-92e4-32ce452daecc req-d1486929-0cb8-42c9-9c93-53f3b5d15956 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:23.551468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-9f2e615d-4d01-4fe0-92e4-32ce452daecc req-d1486929-0cb8-42c9-9c93-53f3b5d15956 service nova] Creating event network-vif-plugged:83d3e4fd-d88a-4c8f-85f4-86112f998a96 for instance 5530cea9-7344-405e-bf59-9d4f629dddbc on hv-cinder-85001 Jul 18 02:39:23.556896 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-9f2e615d-4d01-4fe0-92e4-32ce452daecc req-d1486929-0cb8-42c9-9c93-53f3b5d15956 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033223 Jul 18 02:39:23.557739 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 312/632] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:23.880430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8b5975fb-527b-4318-81e1-41354721c870 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:23.881043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8b5975fb-527b-4318-81e1-41354721c870 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:23.887152 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8b5975fb-527b-4318-81e1-41354721c870 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:23.887605 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8b5975fb-527b-4318-81e1-41354721c870 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:23.888364 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8b5975fb-527b-4318-81e1-41354721c870 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:23.888804 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8b5975fb-527b-4318-81e1-41354721c870 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.022191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8b5975fb-527b-4318-81e1-41354721c870 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:24.029632 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8b5975fb-527b-4318-81e1-41354721c870 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1677 microversion: 2.1 time: 0.153126 Jul 18 02:39:24.031989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 321/633] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:23 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:24.242353 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5f9a69f1-1296-4674-a576-bbd4a411c91e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:24.243281 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5f9a69f1-1296-4674-a576-bbd4a411c91e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:24.249858 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f9a69f1-1296-4674-a576-bbd4a411c91e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.250364 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f9a69f1-1296-4674-a576-bbd4a411c91e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.251127 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f9a69f1-1296-4674-a576-bbd4a411c91e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.251566 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f9a69f1-1296-4674-a576-bbd4a411c91e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.351136 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-efbe7967-1924-4bdc-b03d-81097789e843 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:24.352144 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-efbe7967-1924-4bdc-b03d-81097789e843 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:24.358043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-efbe7967-1924-4bdc-b03d-81097789e843 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.359202 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-efbe7967-1924-4bdc-b03d-81097789e843 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.360159 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-efbe7967-1924-4bdc-b03d-81097789e843 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.360599 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-efbe7967-1924-4bdc-b03d-81097789e843 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.383578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-efbe7967-1924-4bdc-b03d-81097789e843 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lazy-loading 'flavor' on Instance uuid 202ad2e8-7648-4965-afb6-736cb94b74ac {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:24.384594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5f9a69f1-1296-4674-a576-bbd4a411c91e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:24.392671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5f9a69f1-1296-4674-a576-bbd4a411c91e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1366 microversion: 2.1 time: 0.155176 Jul 18 02:39:24.393242 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 313/634] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:24 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:24.398461 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:24.743063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-efbe7967-1924-4bdc-b03d-81097789e843 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/action" status: 200 len: 32 microversion: 2.1 time: 0.395794 Jul 18 02:39:24.743940 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 322/635] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:24 2022] POST /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/action => generated 32 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:39:24.765669 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-40b62c70-9d88-4b76-93f9-24b4b02b3fde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:24.766314 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-40b62c70-9d88-4b76-93f9-24b4b02b3fde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:24.772688 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-40b62c70-9d88-4b76-93f9-24b4b02b3fde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.773299 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-40b62c70-9d88-4b76-93f9-24b4b02b3fde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.774197 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-40b62c70-9d88-4b76-93f9-24b4b02b3fde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:24.774686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-40b62c70-9d88-4b76-93f9-24b4b02b3fde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:24.903131 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-40b62c70-9d88-4b76-93f9-24b4b02b3fde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:24.911742 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-40b62c70-9d88-4b76-93f9-24b4b02b3fde tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.150722 Jul 18 02:39:24.912350 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 314/636] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:24 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:25.049136 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-df72cae9-30f0-4def-b9eb-710449434dd2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:25.049878 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-df72cae9-30f0-4def-b9eb-710449434dd2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:25.056190 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-df72cae9-30f0-4def-b9eb-710449434dd2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.056639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-df72cae9-30f0-4def-b9eb-710449434dd2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.057403 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-df72cae9-30f0-4def-b9eb-710449434dd2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.057843 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-df72cae9-30f0-4def-b9eb-710449434dd2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.191239 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-df72cae9-30f0-4def-b9eb-710449434dd2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:25.198972 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-df72cae9-30f0-4def-b9eb-710449434dd2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1654 microversion: 2.1 time: 0.155570 Jul 18 02:39:25.199544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 323/637] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:25 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:25.217862 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-39b8dcb1-86f3-47d9-adae-f5b3336a9a8e tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:25.224113 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-39b8dcb1-86f3-47d9-adae-f5b3336a9a8e tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.224567 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-39b8dcb1-86f3-47d9-adae-f5b3336a9a8e tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.247057 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-39b8dcb1-86f3-47d9-adae-f5b3336a9a8e tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Going to try to start instance {{(pid=124891) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 02:39:25.261475 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:25.409229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4e7350e3-6cfa-49f2-8dd7-07614483a3e6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:25.409799 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4e7350e3-6cfa-49f2-8dd7-07614483a3e6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:25.415688 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e7350e3-6cfa-49f2-8dd7-07614483a3e6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.416130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e7350e3-6cfa-49f2-8dd7-07614483a3e6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.416876 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e7350e3-6cfa-49f2-8dd7-07614483a3e6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.417313 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4e7350e3-6cfa-49f2-8dd7-07614483a3e6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.468609 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-39b8dcb1-86f3-47d9-adae-f5b3336a9a8e tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/action" status: 202 len: 0 microversion: 2.1 time: 0.253846 Jul 18 02:39:25.469218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 315/638] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:25 2022] POST /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:39:25.477768 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a61b19ec-3f5a-42b1-9439-c0c7423df37f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:25.478502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a61b19ec-3f5a-42b1-9439-c0c7423df37f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:25.485906 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a61b19ec-3f5a-42b1-9439-c0c7423df37f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.486408 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a61b19ec-3f5a-42b1-9439-c0c7423df37f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.487204 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a61b19ec-3f5a-42b1-9439-c0c7423df37f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.487639 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a61b19ec-3f5a-42b1-9439-c0c7423df37f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.630630 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a61b19ec-3f5a-42b1-9439-c0c7423df37f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:25.638436 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a61b19ec-3f5a-42b1-9439-c0c7423df37f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1663 microversion: 2.1 time: 0.164701 Jul 18 02:39:25.639022 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 316/639] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:25 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:25.767057 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4e7350e3-6cfa-49f2-8dd7-07614483a3e6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:25.774334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4e7350e3-6cfa-49f2-8dd7-07614483a3e6 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1366 microversion: 2.1 time: 0.369491 Jul 18 02:39:25.774902 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 324/640] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:25 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:25.929814 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e62ddfd7-eeea-45cc-a531-5032ad600f84 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:25.930444 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e62ddfd7-eeea-45cc-a531-5032ad600f84 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:25.936516 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e62ddfd7-eeea-45cc-a531-5032ad600f84 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.937558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e62ddfd7-eeea-45cc-a531-5032ad600f84 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:25.938346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e62ddfd7-eeea-45cc-a531-5032ad600f84 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:25.938777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e62ddfd7-eeea-45cc-a531-5032ad600f84 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.153815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e62ddfd7-eeea-45cc-a531-5032ad600f84 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:26.163687 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e62ddfd7-eeea-45cc-a531-5032ad600f84 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.237834 Jul 18 02:39:26.164284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 317/641] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:25 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:26.656731 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2f232c13-dce7-4e3f-9113-b5ad446ccd17 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:26.657392 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2f232c13-dce7-4e3f-9113-b5ad446ccd17 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:26.664118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2f232c13-dce7-4e3f-9113-b5ad446ccd17 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.664571 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2f232c13-dce7-4e3f-9113-b5ad446ccd17 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.665385 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2f232c13-dce7-4e3f-9113-b5ad446ccd17 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.665819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2f232c13-dce7-4e3f-9113-b5ad446ccd17 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.791133 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b1c4162a-c26c-4624-8e18-4f2c193fba5b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:26.791934 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b1c4162a-c26c-4624-8e18-4f2c193fba5b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:26.799238 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b1c4162a-c26c-4624-8e18-4f2c193fba5b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.799821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b1c4162a-c26c-4624-8e18-4f2c193fba5b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.800844 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b1c4162a-c26c-4624-8e18-4f2c193fba5b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:26.801472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b1c4162a-c26c-4624-8e18-4f2c193fba5b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:26.804571 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2f232c13-dce7-4e3f-9113-b5ad446ccd17 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:26.812941 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2f232c13-dce7-4e3f-9113-b5ad446ccd17 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1663 microversion: 2.1 time: 0.160761 Jul 18 02:39:26.814131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 325/642] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:26 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:26.985962 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b1c4162a-c26c-4624-8e18-4f2c193fba5b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:26.994387 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b1c4162a-c26c-4624-8e18-4f2c193fba5b tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1556 microversion: 2.1 time: 0.207009 Jul 18 02:39:26.995046 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 318/643] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:26 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1556 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:27.011180 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f443d789-ed3b-45ea-843a-a72493cae263 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:27.011701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f443d789-ed3b-45ea-843a-a72493cae263 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:27.018443 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f443d789-ed3b-45ea-843a-a72493cae263 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.018889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f443d789-ed3b-45ea-843a-a72493cae263 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.019650 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f443d789-ed3b-45ea-843a-a72493cae263 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.020085 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f443d789-ed3b-45ea-843a-a72493cae263 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.100912 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f443d789-ed3b-45ea-843a-a72493cae263 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093529 Jul 18 02:39:27.101513 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 326/644] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 18 02:39:27 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:27.183149 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-99665759-d17a-4ee7-b47b-9fa809dd9b67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:27.183757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-99665759-d17a-4ee7-b47b-9fa809dd9b67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:27.190508 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99665759-d17a-4ee7-b47b-9fa809dd9b67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.190963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99665759-d17a-4ee7-b47b-9fa809dd9b67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.191729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99665759-d17a-4ee7-b47b-9fa809dd9b67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.192166 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99665759-d17a-4ee7-b47b-9fa809dd9b67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.329507 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-99665759-d17a-4ee7-b47b-9fa809dd9b67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:27.337540 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-99665759-d17a-4ee7-b47b-9fa809dd9b67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.158305 Jul 18 02:39:27.338342 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 319/645] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:27 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:27.831177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-64a818bc-d15c-42b6-be1e-321c120228b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:27.831810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-64a818bc-d15c-42b6-be1e-321c120228b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:27.838289 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-64a818bc-d15c-42b6-be1e-321c120228b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.838756 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-64a818bc-d15c-42b6-be1e-321c120228b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:27.839725 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-64a818bc-d15c-42b6-be1e-321c120228b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:27.840126 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-64a818bc-d15c-42b6-be1e-321c120228b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.044260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-64a818bc-d15c-42b6-be1e-321c120228b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:28.053127 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-64a818bc-d15c-42b6-be1e-321c120228b6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1663 microversion: 2.1 time: 0.226565 Jul 18 02:39:28.053785 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 327/646] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:27 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1663 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:28.185397 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-b42c0f40-7e09-42f2-888b-0a5a86cb8dbd req-2d8678e2-ecae-4912-876c-5535c5a8e5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5530cea9-7344-405e-bf59-9d4f629dddbc", "tag": "83d3e4fd-d88a-4c8f-85f4-86112f998a96"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:28.194328 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-b42c0f40-7e09-42f2-888b-0a5a86cb8dbd req-2d8678e2-ecae-4912-876c-5535c5a8e5da service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.204801 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-b42c0f40-7e09-42f2-888b-0a5a86cb8dbd req-2d8678e2-ecae-4912-876c-5535c5a8e5da service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.207143 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-b42c0f40-7e09-42f2-888b-0a5a86cb8dbd req-2d8678e2-ecae-4912-876c-5535c5a8e5da service nova] Creating event network-changed:83d3e4fd-d88a-4c8f-85f4-86112f998a96 for instance 5530cea9-7344-405e-bf59-9d4f629dddbc on hv-cinder-85001 Jul 18 02:39:28.212509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-b42c0f40-7e09-42f2-888b-0a5a86cb8dbd req-2d8678e2-ecae-4912-876c-5535c5a8e5da service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030825 Jul 18 02:39:28.213103 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 320/647] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:28.355537 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cd4993f3-1920-4d46-a4f0-6dd0ea3c2767 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:28.356108 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cd4993f3-1920-4d46-a4f0-6dd0ea3c2767 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:28.363078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd4993f3-1920-4d46-a4f0-6dd0ea3c2767 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.366449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd4993f3-1920-4d46-a4f0-6dd0ea3c2767 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.366449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd4993f3-1920-4d46-a4f0-6dd0ea3c2767 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:28.366449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cd4993f3-1920-4d46-a4f0-6dd0ea3c2767 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:28.504693 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cd4993f3-1920-4d46-a4f0-6dd0ea3c2767 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:28.513695 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cd4993f3-1920-4d46-a4f0-6dd0ea3c2767 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.162278 Jul 18 02:39:28.514513 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 328/648] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:28 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:29.073534 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-67487f41-612a-4226-8d52-e4e76c01c67a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:29.074383 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-67487f41-612a-4226-8d52-e4e76c01c67a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:29.087547 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-67487f41-612a-4226-8d52-e4e76c01c67a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.088093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-67487f41-612a-4226-8d52-e4e76c01c67a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.089258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-67487f41-612a-4226-8d52-e4e76c01c67a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.089773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-67487f41-612a-4226-8d52-e4e76c01c67a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.224004 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-67487f41-612a-4226-8d52-e4e76c01c67a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:29.232524 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-67487f41-612a-4226-8d52-e4e76c01c67a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1667 microversion: 2.1 time: 0.165288 Jul 18 02:39:29.233107 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 321/649] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:29 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:29.531106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a90b7e29-fd84-431f-809c-aaeb3a6c2943 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:29.531786 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a90b7e29-fd84-431f-809c-aaeb3a6c2943 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:29.538387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a90b7e29-fd84-431f-809c-aaeb3a6c2943 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.538839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a90b7e29-fd84-431f-809c-aaeb3a6c2943 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.539640 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a90b7e29-fd84-431f-809c-aaeb3a6c2943 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:29.540079 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a90b7e29-fd84-431f-809c-aaeb3a6c2943 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:29.673457 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a90b7e29-fd84-431f-809c-aaeb3a6c2943 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:29.681600 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a90b7e29-fd84-431f-809c-aaeb3a6c2943 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.154425 Jul 18 02:39:29.682189 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 329/650] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:29 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:30.700007 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bca5d105-5a55-415d-a521-d1ff0aea575a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:30.700621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bca5d105-5a55-415d-a521-d1ff0aea575a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:30.707923 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bca5d105-5a55-415d-a521-d1ff0aea575a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:30.708374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bca5d105-5a55-415d-a521-d1ff0aea575a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:30.709143 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bca5d105-5a55-415d-a521-d1ff0aea575a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:30.709590 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bca5d105-5a55-415d-a521-d1ff0aea575a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:30.838788 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bca5d105-5a55-415d-a521-d1ff0aea575a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:30.846705 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bca5d105-5a55-415d-a521-d1ff0aea575a tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.150558 Jul 18 02:39:30.847265 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 322/651] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:30 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:31.864971 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4acf717e-2930-42e1-b7a1-8a71f29edf52 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:31.865576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4acf717e-2930-42e1-b7a1-8a71f29edf52 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:31.873214 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4acf717e-2930-42e1-b7a1-8a71f29edf52 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:31.873749 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4acf717e-2930-42e1-b7a1-8a71f29edf52 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:31.875381 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4acf717e-2930-42e1-b7a1-8a71f29edf52 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:31.875963 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4acf717e-2930-42e1-b7a1-8a71f29edf52 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:32.007485 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4acf717e-2930-42e1-b7a1-8a71f29edf52 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:32.015488 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4acf717e-2930-42e1-b7a1-8a71f29edf52 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.154984 Jul 18 02:39:32.016059 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 330/652] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:31 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:33.033200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cea03283-7f8c-4082-a625-4ecbecb41c36 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:33.033790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-cea03283-7f8c-4082-a625-4ecbecb41c36 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:33.040333 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cea03283-7f8c-4082-a625-4ecbecb41c36 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:33.040828 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cea03283-7f8c-4082-a625-4ecbecb41c36 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:33.041543 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cea03283-7f8c-4082-a625-4ecbecb41c36 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:33.041979 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cea03283-7f8c-4082-a625-4ecbecb41c36 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:33.168784 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-cea03283-7f8c-4082-a625-4ecbecb41c36 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:33.177890 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-cea03283-7f8c-4082-a625-4ecbecb41c36 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.149051 Jul 18 02:39:33.178488 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 323/653] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:33 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:34.194902 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-48e1ff4a-eb0a-41c8-85cb-22cc39613b85 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:34.195522 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-48e1ff4a-eb0a-41c8-85cb-22cc39613b85 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:34.202244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-48e1ff4a-eb0a-41c8-85cb-22cc39613b85 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:34.202702 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-48e1ff4a-eb0a-41c8-85cb-22cc39613b85 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:34.203494 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-48e1ff4a-eb0a-41c8-85cb-22cc39613b85 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:34.203935 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-48e1ff4a-eb0a-41c8-85cb-22cc39613b85 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:34.336371 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-48e1ff4a-eb0a-41c8-85cb-22cc39613b85 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:34.345063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-48e1ff4a-eb0a-41c8-85cb-22cc39613b85 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.153964 Jul 18 02:39:34.345630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 331/654] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:34 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:35.363033 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c7f34fa2-34c8-4b62-86df-416a9f966abd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:35.363615 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c7f34fa2-34c8-4b62-86df-416a9f966abd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:35.370165 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c7f34fa2-34c8-4b62-86df-416a9f966abd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:35.370611 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c7f34fa2-34c8-4b62-86df-416a9f966abd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:35.371358 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c7f34fa2-34c8-4b62-86df-416a9f966abd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:35.371788 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c7f34fa2-34c8-4b62-86df-416a9f966abd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:35.498953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c7f34fa2-34c8-4b62-86df-416a9f966abd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:35.511777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c7f34fa2-34c8-4b62-86df-416a9f966abd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.153305 Jul 18 02:39:35.512349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 324/655] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:35 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:36.528693 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-65719329-24f4-46a2-aa52-b077b5b3398d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:36.529287 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-65719329-24f4-46a2-aa52-b077b5b3398d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:36.535756 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-65719329-24f4-46a2-aa52-b077b5b3398d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:36.536196 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-65719329-24f4-46a2-aa52-b077b5b3398d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:36.536946 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-65719329-24f4-46a2-aa52-b077b5b3398d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:36.537374 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-65719329-24f4-46a2-aa52-b077b5b3398d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:36.667937 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-65719329-24f4-46a2-aa52-b077b5b3398d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:36.676984 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-65719329-24f4-46a2-aa52-b077b5b3398d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.152097 Jul 18 02:39:36.677555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 332/656] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:36 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:37.694002 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-48d2d1c0-334c-46d8-af13-f40178e3f300 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:37.694639 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-48d2d1c0-334c-46d8-af13-f40178e3f300 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:37.701334 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-48d2d1c0-334c-46d8-af13-f40178e3f300 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.701784 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-48d2d1c0-334c-46d8-af13-f40178e3f300 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.702580 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-48d2d1c0-334c-46d8-af13-f40178e3f300 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:37.703014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-48d2d1c0-334c-46d8-af13-f40178e3f300 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:37.837197 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-48d2d1c0-334c-46d8-af13-f40178e3f300 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:37.845045 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-48d2d1c0-334c-46d8-af13-f40178e3f300 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.154869 Jul 18 02:39:37.846199 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 325/657] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:37 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:38.863168 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-37159b4c-9d73-4d60-8e29-61c1d7016f67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:38.863786 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-37159b4c-9d73-4d60-8e29-61c1d7016f67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:38.866206 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:38.870988 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-37159b4c-9d73-4d60-8e29-61c1d7016f67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.871442 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-37159b4c-9d73-4d60-8e29-61c1d7016f67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:38.872208 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-37159b4c-9d73-4d60-8e29-61c1d7016f67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:38.872647 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-37159b4c-9d73-4d60-8e29-61c1d7016f67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:39.000945 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-37159b4c-9d73-4d60-8e29-61c1d7016f67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:39.008906 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-37159b4c-9d73-4d60-8e29-61c1d7016f67 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.150302 Jul 18 02:39:39.009474 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 333/658] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:38 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:39.310294 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-73e092f0-d648-4755-9bfe-0b4f03be67d7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:39.310902 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-73e092f0-d648-4755-9bfe-0b4f03be67d7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:39.317300 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73e092f0-d648-4755-9bfe-0b4f03be67d7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:39.317746 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73e092f0-d648-4755-9bfe-0b4f03be67d7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:39.318533 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73e092f0-d648-4755-9bfe-0b4f03be67d7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:39.319064 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73e092f0-d648-4755-9bfe-0b4f03be67d7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:39.348196 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-73e092f0-d648-4755-9bfe-0b4f03be67d7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments/0f1560e6-e4f6-49a3-844c-fe7bc9d5d1d9" status: 200 len: 194 microversion: 2.20 time: 0.041924 Jul 18 02:39:39.348774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 326/659] 10.222.0.66 () {60 vars in 1453 bytes} [Mon Jul 18 02:39:39 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments/0f1560e6-e4f6-49a3-844c-fe7bc9d5d1d9 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:39:39.412765 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-aeee057b-6fbe-4747-bb0f-8072478e5abb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:39.413276 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-aeee057b-6fbe-4747-bb0f-8072478e5abb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:39.419220 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aeee057b-6fbe-4747-bb0f-8072478e5abb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:39.419665 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aeee057b-6fbe-4747-bb0f-8072478e5abb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:39.420469 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aeee057b-6fbe-4747-bb0f-8072478e5abb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:39.420899 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-aeee057b-6fbe-4747-bb0f-8072478e5abb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:39.543142 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-aeee057b-6fbe-4747-bb0f-8072478e5abb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lazy-loading 'services' on Instance uuid 68d974b9-4abf-4d7f-bbea-08e8fef381dd {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:39.925415 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-aeee057b-6fbe-4747-bb0f-8072478e5abb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "DELETE /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments/0f1560e6-e4f6-49a3-844c-fe7bc9d5d1d9" status: 202 len: 0 microversion: 2.20 time: 0.516311 Jul 18 02:39:39.926137 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 334/660] 10.222.0.66 () {60 vars in 1456 bytes} [Mon Jul 18 02:39:39 2022] DELETE /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments/0f1560e6-e4f6-49a3-844c-fe7bc9d5d1d9 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:39:39.935241 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ad4a416c-715e-449a-b39c-dbe492ed934c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:39.936768 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ad4a416c-715e-449a-b39c-dbe492ed934c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:39.942882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ad4a416c-715e-449a-b39c-dbe492ed934c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:39.943335 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ad4a416c-715e-449a-b39c-dbe492ed934c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:39.944098 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ad4a416c-715e-449a-b39c-dbe492ed934c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:39.944531 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ad4a416c-715e-449a-b39c-dbe492ed934c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:39.973166 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ad4a416c-715e-449a-b39c-dbe492ed934c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042632 Jul 18 02:39:39.973716 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 327/661] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Jul 18 02:39:39 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:39:40.026571 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cfdb69df-9928-4cbc-b64a-2c83c09ad107 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:40.027191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cfdb69df-9928-4cbc-b64a-2c83c09ad107 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:40.033326 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cfdb69df-9928-4cbc-b64a-2c83c09ad107 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.033928 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cfdb69df-9928-4cbc-b64a-2c83c09ad107 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:40.034725 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cfdb69df-9928-4cbc-b64a-2c83c09ad107 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.035207 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cfdb69df-9928-4cbc-b64a-2c83c09ad107 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:40.177700 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cfdb69df-9928-4cbc-b64a-2c83c09ad107 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:40.185609 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cfdb69df-9928-4cbc-b64a-2c83c09ad107 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.163397 Jul 18 02:39:40.186184 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 335/662] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:40 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:40.984993 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f935cd7b-293c-4695-837d-934a95e30356 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:40.985900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f935cd7b-293c-4695-837d-934a95e30356 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:40.992491 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f935cd7b-293c-4695-837d-934a95e30356 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.992933 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f935cd7b-293c-4695-837d-934a95e30356 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:40.993680 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f935cd7b-293c-4695-837d-934a95e30356 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:40.994132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f935cd7b-293c-4695-837d-934a95e30356 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:41.024069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f935cd7b-293c-4695-837d-934a95e30356 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043144 Jul 18 02:39:41.024618 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 328/663] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Jul 18 02:39:40 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:39:41.203515 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f4aff37d-b46e-480e-b2ec-6b699fc9e5f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:41.204133 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f4aff37d-b46e-480e-b2ec-6b699fc9e5f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:41.211471 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4aff37d-b46e-480e-b2ec-6b699fc9e5f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:41.211920 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4aff37d-b46e-480e-b2ec-6b699fc9e5f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:41.212712 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4aff37d-b46e-480e-b2ec-6b699fc9e5f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:41.213146 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f4aff37d-b46e-480e-b2ec-6b699fc9e5f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:41.343169 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f4aff37d-b46e-480e-b2ec-6b699fc9e5f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:41.351238 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f4aff37d-b46e-480e-b2ec-6b699fc9e5f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.151541 Jul 18 02:39:41.351842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 336/664] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:41 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:42.036436 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5c0890f8-75d0-4a6f-9b89-7da923d115cd tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:42.037354 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5c0890f8-75d0-4a6f-9b89-7da923d115cd tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:42.043779 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5c0890f8-75d0-4a6f-9b89-7da923d115cd tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.044233 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5c0890f8-75d0-4a6f-9b89-7da923d115cd tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.044999 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5c0890f8-75d0-4a6f-9b89-7da923d115cd tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.045441 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5c0890f8-75d0-4a6f-9b89-7da923d115cd tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.073838 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5c0890f8-75d0-4a6f-9b89-7da923d115cd tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042022 Jul 18 02:39:42.074424 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 329/665] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Jul 18 02:39:42 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:42.130966 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0df97d82-7266-49c1-a923-66c761aa15fe tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:42.131459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0df97d82-7266-49c1-a923-66c761aa15fe tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:42.137314 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0df97d82-7266-49c1-a923-66c761aa15fe tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.137760 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0df97d82-7266-49c1-a923-66c761aa15fe tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.138568 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0df97d82-7266-49c1-a923-66c761aa15fe tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.139005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0df97d82-7266-49c1-a923-66c761aa15fe tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.156584 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:42.164362 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0df97d82-7266-49c1-a923-66c761aa15fe tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Going to try to terminate instance {{(pid=124890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:39:42.368551 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-37b7c6cb-59b7-41e2-a3b5-514fdac533b3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:42.369110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-37b7c6cb-59b7-41e2-a3b5-514fdac533b3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:42.375269 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-37b7c6cb-59b7-41e2-a3b5-514fdac533b3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.375720 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-37b7c6cb-59b7-41e2-a3b5-514fdac533b3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.376477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-37b7c6cb-59b7-41e2-a3b5-514fdac533b3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.376913 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-37b7c6cb-59b7-41e2-a3b5-514fdac533b3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.477467 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0df97d82-7266-49c1-a923-66c761aa15fe tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "DELETE /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 204 len: 0 microversion: 2.20 time: 0.350135 Jul 18 02:39:42.480641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 337/666] 10.222.0.66 () {60 vars in 1279 bytes} [Mon Jul 18 02:39:42 2022] DELETE /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:42.487367 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6bd7da79-3ec5-423a-92b5-7c7fb88bbd47 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:42.488083 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6bd7da79-3ec5-423a-92b5-7c7fb88bbd47 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:42.494166 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bd7da79-3ec5-423a-92b5-7c7fb88bbd47 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.494619 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bd7da79-3ec5-423a-92b5-7c7fb88bbd47 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.495383 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bd7da79-3ec5-423a-92b5-7c7fb88bbd47 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:42.495817 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bd7da79-3ec5-423a-92b5-7c7fb88bbd47 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:42.510103 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-37b7c6cb-59b7-41e2-a3b5-514fdac533b3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:42.518122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-37b7c6cb-59b7-41e2-a3b5-514fdac533b3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.153594 Jul 18 02:39:42.519468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 330/667] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:42 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:42.631552 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6bd7da79-3ec5-423a-92b5-7c7fb88bbd47 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:42.639712 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6bd7da79-3ec5-423a-92b5-7c7fb88bbd47 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:42.641220 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6bd7da79-3ec5-423a-92b5-7c7fb88bbd47 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:42.642425 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6bd7da79-3ec5-423a-92b5-7c7fb88bbd47 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.159589 Jul 18 02:39:42.643128 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 338/668] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:42 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:43.536284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-074a5780-7a49-4f66-977a-0d8795edd0a0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:43.536874 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-074a5780-7a49-4f66-977a-0d8795edd0a0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:43.543464 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-074a5780-7a49-4f66-977a-0d8795edd0a0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:43.543914 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-074a5780-7a49-4f66-977a-0d8795edd0a0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:43.544679 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-074a5780-7a49-4f66-977a-0d8795edd0a0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:43.545113 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-074a5780-7a49-4f66-977a-0d8795edd0a0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:43.662659 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8135b61d-790f-49c1-8a29-4e4a8260e20c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:43.663283 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8135b61d-790f-49c1-8a29-4e4a8260e20c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:43.669952 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8135b61d-790f-49c1-8a29-4e4a8260e20c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:43.670431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8135b61d-790f-49c1-8a29-4e4a8260e20c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:43.671189 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8135b61d-790f-49c1-8a29-4e4a8260e20c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:43.671619 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8135b61d-790f-49c1-8a29-4e4a8260e20c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:43.678241 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-074a5780-7a49-4f66-977a-0d8795edd0a0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:43.686166 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-074a5780-7a49-4f66-977a-0d8795edd0a0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.154262 Jul 18 02:39:43.686959 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 331/669] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:43 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:43.801307 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8135b61d-790f-49c1-8a29-4e4a8260e20c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:43.809924 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8135b61d-790f-49c1-8a29-4e4a8260e20c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:43.811422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8135b61d-790f-49c1-8a29-4e4a8260e20c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:43.812561 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8135b61d-790f-49c1-8a29-4e4a8260e20c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.154783 Jul 18 02:39:43.813114 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 339/670] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:43 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:44.703219 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f3059e9e-8388-4452-bf34-9c23e2b0949c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:44.703795 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f3059e9e-8388-4452-bf34-9c23e2b0949c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:44.712113 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f3059e9e-8388-4452-bf34-9c23e2b0949c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:44.712570 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f3059e9e-8388-4452-bf34-9c23e2b0949c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:44.713381 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f3059e9e-8388-4452-bf34-9c23e2b0949c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:44.713823 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f3059e9e-8388-4452-bf34-9c23e2b0949c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:44.730452 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:44.832465 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-eb7179c0-4959-4bf0-a126-969b718181f7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:44.833114 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-eb7179c0-4959-4bf0-a126-969b718181f7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:44.839991 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eb7179c0-4959-4bf0-a126-969b718181f7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:44.840445 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eb7179c0-4959-4bf0-a126-969b718181f7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:44.841217 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eb7179c0-4959-4bf0-a126-969b718181f7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:44.841651 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-eb7179c0-4959-4bf0-a126-969b718181f7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:44.978782 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-eb7179c0-4959-4bf0-a126-969b718181f7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:44.987349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-eb7179c0-4959-4bf0-a126-969b718181f7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:44.988938 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-eb7179c0-4959-4bf0-a126-969b718181f7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:44.990237 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-eb7179c0-4959-4bf0-a126-969b718181f7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1724 microversion: 2.20 time: 0.162563 Jul 18 02:39:44.990802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 340/671] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:44 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:45.085843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f3059e9e-8388-4452-bf34-9c23e2b0949c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:45.093850 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f3059e9e-8388-4452-bf34-9c23e2b0949c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.394615 Jul 18 02:39:45.094649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 332/672] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:44 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:45.697162 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-14e2bd08-bcef-4356-935b-cfac2f0fe23c req-747dec85-77ea-4b06-bc68-b2baa089d3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d974b9-4abf-4d7f-bbea-08e8fef381dd", "name": "network-vif-deleted", "tag": "3185ab6e-a508-4ad1-b269-07229430860b"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:45.704931 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-14e2bd08-bcef-4356-935b-cfac2f0fe23c req-747dec85-77ea-4b06-bc68-b2baa089d3ba service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:45.704931 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-14e2bd08-bcef-4356-935b-cfac2f0fe23c req-747dec85-77ea-4b06-bc68-b2baa089d3ba service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:45.718519 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-14e2bd08-bcef-4356-935b-cfac2f0fe23c req-747dec85-77ea-4b06-bc68-b2baa089d3ba service nova] Creating event network-vif-deleted:3185ab6e-a508-4ad1-b269-07229430860b for instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd on hv-cinder-85001 Jul 18 02:39:45.724169 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-14e2bd08-bcef-4356-935b-cfac2f0fe23c req-747dec85-77ea-4b06-bc68-b2baa089d3ba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 Jul 18 02:39:45.724723 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 341/673] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:46.011933 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:46.011933 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:46.015885 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:46.016330 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:46.017100 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:46.017513 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:46.050982 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:46.051430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:46.051881 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lazy-loading 'fault' on Instance uuid 68d974b9-4abf-4d7f-bbea-08e8fef381dd {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:39:46.094111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:46.103517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:46.105054 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:46.106289 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-abbebf16-9521-429b-9247-e90f0482c126 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 200 len: 1372 microversion: 2.20 time: 0.101513 Jul 18 02:39:46.107013 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 333/674] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:46 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:46.111847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-18e7553e-6cdf-401f-b166-c00517aaa218 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:46.112985 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-18e7553e-6cdf-401f-b166-c00517aaa218 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:46.119692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-18e7553e-6cdf-401f-b166-c00517aaa218 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:46.120321 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-18e7553e-6cdf-401f-b166-c00517aaa218 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:46.121187 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-18e7553e-6cdf-401f-b166-c00517aaa218 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:46.121679 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-18e7553e-6cdf-401f-b166-c00517aaa218 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:46.255775 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-18e7553e-6cdf-401f-b166-c00517aaa218 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:46.263882 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-18e7553e-6cdf-401f-b166-c00517aaa218 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.156414 Jul 18 02:39:46.264462 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 342/675] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:46 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:47.124499 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8697d093-e54a-4650-ad70-66417e05e979 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:47.125077 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8697d093-e54a-4650-ad70-66417e05e979 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:47.132129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8697d093-e54a-4650-ad70-66417e05e979 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:47.132575 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8697d093-e54a-4650-ad70-66417e05e979 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:47.133328 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8697d093-e54a-4650-ad70-66417e05e979 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:47.133760 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8697d093-e54a-4650-ad70-66417e05e979 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:47.147502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-8697d093-e54a-4650-ad70-66417e05e979 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] HTTP exception thrown: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8697d093-e54a-4650-ad70-66417e05e979 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Request method failure captured: Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd HTTP/1.1 Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbkdXCXH6B-DfPmWoAtNMdORV523wv4eaywAxBpxNxeD7XAvm1nGTogJGHaztpFiri2zdF6kUtH7D7AyysIBMVKmrgybQcVWbX6BHRxEtCYHPKxONCMwmtyH1YQFwspHQLbYYKUogGt32bW5UfpokJWqXcbdhSToFC_zWNqur-XwL4 Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:39:47.149111 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f3c1745729fe47238223557221c2e905"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f3c1745729fe47238223557221c2e905", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 7ddb197852db4b20a84aa6c0862468ef Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:39:47.150854 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '68d974b9-4abf-4d7f-bbea-08e8fef381dd'} Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:47.151722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:39:47.152970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:47.154208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8697d093-e54a-4650-ad70-66417e05e979 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Returning 404 to user: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:47.154208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8697d093-e54a-4650-ad70-66417e05e979 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 404 len: 111 microversion: 2.20 time: 0.029904 Jul 18 02:39:47.154208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 334/676] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:47 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:39:47.159342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3f9d3496-625c-449b-aa7e-5d7427fe967f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '.version_select at 0x7f28eddd9e50>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:47.244272 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3f9d3496-625c-449b-aa7e-5d7427fe967f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922065731" status: 204 len: 0 microversion: 2.20 time: 0.088683 Jul 18 02:39:47.244866 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 343/677] 10.222.0.66 () {60 vars in 1261 bytes} [Mon Jul 18 02:39:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922065731 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:39:47.280957 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-81a465f2-0cb1-43aa-bb78-a60b41accdfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:47.281487 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-81a465f2-0cb1-43aa-bb78-a60b41accdfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:47.287604 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-81a465f2-0cb1-43aa-bb78-a60b41accdfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:47.288053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-81a465f2-0cb1-43aa-bb78-a60b41accdfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:47.288883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-81a465f2-0cb1-43aa-bb78-a60b41accdfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:47.289272 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-81a465f2-0cb1-43aa-bb78-a60b41accdfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:47.421777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-81a465f2-0cb1-43aa-bb78-a60b41accdfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:47.430450 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-81a465f2-0cb1-43aa-bb78-a60b41accdfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.153434 Jul 18 02:39:47.436928 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 335/678] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:47 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:48.109976 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f0ba367b-be76-4cff-b7b2-1eda90c84d42 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Action: 'create', calling method: .version_select at 0x7f28edcae940>, body: {"keypair": {"name": "tempest-keypair-71337549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9NyRoOnFetKuDOPpyStV2FJT9dUlFAZAljtLb3wccnth48ldcvuGrkFur+7OIBLluL24OJ0QWllv/FlryolQ1zJmcCbej9kEIE1MFphUWH+NbqD67YvlH91aPXYfti6g=="}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:48.124902 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-f0ba367b-be76-4cff-b7b2-1eda90c84d42 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Getting quotas for project f3c1745729fe47238223557221c2e905. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:39:48.129439 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-f0ba367b-be76-4cff-b7b2-1eda90c84d42 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Getting quotas for user 7ddb197852db4b20a84aa6c0862468ef and project f3c1745729fe47238223557221c2e905. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:39:48.276107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f0ba367b-be76-4cff-b7b2-1eda90c84d42 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.169922 Jul 18 02:39:48.276835 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 344/679] 10.222.0.66 () {62 vars in 1199 bytes} [Mon Jul 18 02:39:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 02:39:48.448974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4cc76e0a-b677-4c44-8daa-3d73d33e8217 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:48.449584 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4cc76e0a-b677-4c44-8daa-3d73d33e8217 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:48.456873 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4cc76e0a-b677-4c44-8daa-3d73d33e8217 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:48.457331 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4cc76e0a-b677-4c44-8daa-3d73d33e8217 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:48.458367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4cc76e0a-b677-4c44-8daa-3d73d33e8217 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:48.458817 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4cc76e0a-b677-4c44-8daa-3d73d33e8217 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:48.642113 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4cc76e0a-b677-4c44-8daa-3d73d33e8217 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:48.650515 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4cc76e0a-b677-4c44-8daa-3d73d33e8217 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.205558 Jul 18 02:39:48.651076 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 336/680] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:48 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:49.669034 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b74984b3-e840-4145-ab45-f9b367241550 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:49.669873 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b74984b3-e840-4145-ab45-f9b367241550 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:49.677018 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b74984b3-e840-4145-ab45-f9b367241550 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:49.677463 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b74984b3-e840-4145-ab45-f9b367241550 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:49.678369 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b74984b3-e840-4145-ab45-f9b367241550 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:49.678802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b74984b3-e840-4145-ab45-f9b367241550 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:49.887458 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b74984b3-e840-4145-ab45-f9b367241550 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:49.895520 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b74984b3-e840-4145-ab45-f9b367241550 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1734 microversion: 2.1 time: 0.230923 Jul 18 02:39:49.896100 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 345/681] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:49 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:50.912896 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-eed092e1-6393-4281-a3e0-fce539f66124 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:50.913617 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-eed092e1-6393-4281-a3e0-fce539f66124 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:50.920161 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eed092e1-6393-4281-a3e0-fce539f66124 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:50.920614 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eed092e1-6393-4281-a3e0-fce539f66124 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:50.921385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eed092e1-6393-4281-a3e0-fce539f66124 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:50.921830 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eed092e1-6393-4281-a3e0-fce539f66124 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.053622 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-eed092e1-6393-4281-a3e0-fce539f66124 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:51.061900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-eed092e1-6393-4281-a3e0-fce539f66124 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1714 microversion: 2.1 time: 0.152965 Jul 18 02:39:51.062505 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 337/682] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:50 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:51.102623 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1544737239", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf656dc8-ef6c-43a1-bbd8-140e60e69fc7"}], "security_groups": [{"name": "tempest-securitygroup--723982977"}], "key_name": "tempest-keypair-71337549", "user_data": "}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:51.171544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cc850070-7a51-49d9-8ddf-e0295d09cebb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:51.172108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-cc850070-7a51-49d9-8ddf-e0295d09cebb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:51.178449 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cc850070-7a51-49d9-8ddf-e0295d09cebb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.180184 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cc850070-7a51-49d9-8ddf-e0295d09cebb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.180184 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cc850070-7a51-49d9-8ddf-e0295d09cebb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.180184 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cc850070-7a51-49d9-8ddf-e0295d09cebb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.204716 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.network.neutron [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] validate_networks() for [('cf656dc8-ef6c-43a1-bbd8-140e60e69fc7', None, None, None, None, None)] {{(pid=124890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:39:51.261063 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-cc850070-7a51-49d9-8ddf-e0295d09cebb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] HTTP exception thrown: Cannot 'detach_volume' instance 202ad2e8-7648-4965-afb6-736cb94b74ac while it is in vm_state rescued Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cc850070-7a51-49d9-8ddf-e0295d09cebb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Request method failure captured: Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: DELETE /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments/d65dbf55-24f0-4fa1-95f8-768138d5c0f4 HTTP/1.1 Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1McuPtx3mXnBtnAQz6hcyUDMQQKVKo-T7dvPGtmZuTuHw7GzvsTn0I34zu4yEdIofz-yDNRRgXDEBOkIkJBrQ94epik1LKFvkwOHcowjlukXqP9m0auyRN8lNxgEcAPqwnRsqanPw5IYVJ7_ivL4Sbf9V6H62dfIQ2mbExpaWFvVh-Y Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 9ec4c1c1687944b98c1c5cefe05df095 Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:39:51.262599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9ec4c1c1687944b98c1c5cefe05df095", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 9ec4c1c1687944b98c1c5cefe05df095 Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-ServerRescueNegativeTestJSON-988773994-project Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: d281c92e20d04004a679a8ec65f9e6d5 Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-ServerRescueNegativeTestJSON-988773994-project Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:39:51.264202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Cannot 'detach_volume' instance 202ad2e8-7648-4965-afb6-736cb94b74ac while it is in vm_state rescued Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'server_id': '202ad2e8-7648-4965-afb6-736cb94b74ac', 'id': 'd65dbf55-24f0-4fa1-95f8-768138d5c0f4'} Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 202ad2e8-7648-4965-afb6-736cb94b74ac in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:39:51.265017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 202ad2e8-7648-4965-afb6-736cb94b74ac while it is in vm_state rescued Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 202ad2e8-7648-4965-afb6-736cb94b74ac while it is in vm_state rescued Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:39:51.266792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cc850070-7a51-49d9-8ddf-e0295d09cebb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Returning 409 to user: Cannot 'detach_volume' instance 202ad2e8-7648-4965-afb6-736cb94b74ac while it is in vm_state rescued {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:39:51.267986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-cc850070-7a51-49d9-8ddf-e0295d09cebb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "DELETE /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments/d65dbf55-24f0-4fa1-95f8-768138d5c0f4" status: 409 len: 152 microversion: 2.1 time: 0.097478 Jul 18 02:39:51.267986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 338/683] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:39:51 2022] DELETE /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments/d65dbf55-24f0-4fa1-95f8-768138d5c0f4 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 18 02:39:51.274757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8ee6673f-3282-4a4b-9dcd-548f2145a49e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:51.275289 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8ee6673f-3282-4a4b-9dcd-548f2145a49e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:51.281234 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ee6673f-3282-4a4b-9dcd-548f2145a49e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.281682 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ee6673f-3282-4a4b-9dcd-548f2145a49e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.282487 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ee6673f-3282-4a4b-9dcd-548f2145a49e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.282916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ee6673f-3282-4a4b-9dcd-548f2145a49e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.480112 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8ee6673f-3282-4a4b-9dcd-548f2145a49e tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "POST /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/action" status: 202 len: 0 microversion: 2.1 time: 0.208837 Jul 18 02:39:51.483797 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 339/684] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:39:51 2022] POST /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:39:51.491937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0e3e5e32-bc5a-491a-aa9d-dff2a57c4192 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:51.494575 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0e3e5e32-bc5a-491a-aa9d-dff2a57c4192 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:51.499086 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0e3e5e32-bc5a-491a-aa9d-dff2a57c4192 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.499540 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0e3e5e32-bc5a-491a-aa9d-dff2a57c4192 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.500303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0e3e5e32-bc5a-491a-aa9d-dff2a57c4192 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.500746 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0e3e5e32-bc5a-491a-aa9d-dff2a57c4192 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.583166 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Flavor limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:39:51.583625 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Image limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:39:51.584108 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Flavor pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:39:51.584519 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Image pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:39:51.584967 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:39:51.593977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.594468 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.595267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:51.595708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:51.623847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Getting quotas for project f3c1745729fe47238223557221c2e905. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:39:51.628009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Getting quotas for user 7ddb197852db4b20a84aa6c0862468ef and project f3c1745729fe47238223557221c2e905. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:39:51.639968 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Going to run 1 instances... {{(pid=124890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:39:51.642329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:39:51.677832 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0e3e5e32-bc5a-491a-aa9d-dff2a57c4192 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:51.686317 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0e3e5e32-bc5a-491a-aa9d-dff2a57c4192 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1722 microversion: 2.1 time: 0.198518 Jul 18 02:39:51.686889 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 340/685] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:51 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:51.785740 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0dbae877-b43c-4ce0-96fb-e56419e85d19 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.688299 Jul 18 02:39:51.786713 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 346/686] 10.222.0.66 () {62 vars in 1187 bytes} [Mon Jul 18 02:39:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 02:39:51.796775 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d4c8cb2d-0cde-4509-8833-31ed6c03ab22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:51.797489 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d4c8cb2d-0cde-4509-8833-31ed6c03ab22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:51.866718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d4c8cb2d-0cde-4509-8833-31ed6c03ab22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:51.875585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d4c8cb2d-0cde-4509-8833-31ed6c03ab22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:51.877459 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d4c8cb2d-0cde-4509-8833-31ed6c03ab22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:51.879210 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d4c8cb2d-0cde-4509-8833-31ed6c03ab22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1280 microversion: 2.20 time: 0.085983 Jul 18 02:39:51.879888 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 341/687] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:51 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:52.704722 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cf65144f-6cdf-4983-917f-d5bece5cb60f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:52.705340 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cf65144f-6cdf-4983-917f-d5bece5cb60f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:52.712109 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cf65144f-6cdf-4983-917f-d5bece5cb60f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.712609 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cf65144f-6cdf-4983-917f-d5bece5cb60f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.713381 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cf65144f-6cdf-4983-917f-d5bece5cb60f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.713823 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cf65144f-6cdf-4983-917f-d5bece5cb60f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.843077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cf65144f-6cdf-4983-917f-d5bece5cb60f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:52.851883 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cf65144f-6cdf-4983-917f-d5bece5cb60f tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1722 microversion: 2.1 time: 0.151513 Jul 18 02:39:52.852454 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 347/688] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:52 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:52.897283 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-83dc9ea5-1042-4589-821b-94d80637c990 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:52.897902 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-83dc9ea5-1042-4589-821b-94d80637c990 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:52.900375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=66 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:52.905922 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-83dc9ea5-1042-4589-821b-94d80637c990 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.906408 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-83dc9ea5-1042-4589-821b-94d80637c990 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.907183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-83dc9ea5-1042-4589-821b-94d80637c990 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:52.907624 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-83dc9ea5-1042-4589-821b-94d80637c990 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:52.968438 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-83dc9ea5-1042-4589-821b-94d80637c990 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:52.977345 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-83dc9ea5-1042-4589-821b-94d80637c990 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:52.978942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-83dc9ea5-1042-4589-821b-94d80637c990 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:52.980043 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-83dc9ea5-1042-4589-821b-94d80637c990 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1284 microversion: 2.20 time: 0.087313 Jul 18 02:39:52.980598 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 342/689] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:52 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:53.869300 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f96c7428-db4d-4609-b449-3eddb8b71245 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:53.869851 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f96c7428-db4d-4609-b449-3eddb8b71245 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:53.876332 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f96c7428-db4d-4609-b449-3eddb8b71245 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.876783 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f96c7428-db4d-4609-b449-3eddb8b71245 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.877542 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f96c7428-db4d-4609-b449-3eddb8b71245 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:53.877976 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f96c7428-db4d-4609-b449-3eddb8b71245 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:53.998297 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c891b17f-a667-4169-bf32-7575ea0ba0fa tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:53.998901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c891b17f-a667-4169-bf32-7575ea0ba0fa tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:54.005941 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c891b17f-a667-4169-bf32-7575ea0ba0fa tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.006405 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c891b17f-a667-4169-bf32-7575ea0ba0fa tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.007292 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c891b17f-a667-4169-bf32-7575ea0ba0fa tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:54.007617 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c891b17f-a667-4169-bf32-7575ea0ba0fa tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:54.008759 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f96c7428-db4d-4609-b449-3eddb8b71245 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:54.016810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f96c7428-db4d-4609-b449-3eddb8b71245 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1722 microversion: 2.1 time: 0.151346 Jul 18 02:39:54.017379 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 348/690] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:53 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:39:54.074099 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c891b17f-a667-4169-bf32-7575ea0ba0fa tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:54.082791 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c891b17f-a667-4169-bf32-7575ea0ba0fa tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:54.084289 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c891b17f-a667-4169-bf32-7575ea0ba0fa tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:54.085382 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c891b17f-a667-4169-bf32-7575ea0ba0fa tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1284 microversion: 2.20 time: 0.091058 Jul 18 02:39:54.085936 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 343/691] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:53 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:55.035873 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-85fab95f-22b4-4ca3-a63f-9fa94f7397cb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:55.036793 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-85fab95f-22b4-4ca3-a63f-9fa94f7397cb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:55.044395 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-85fab95f-22b4-4ca3-a63f-9fa94f7397cb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.044909 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-85fab95f-22b4-4ca3-a63f-9fa94f7397cb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.045926 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-85fab95f-22b4-4ca3-a63f-9fa94f7397cb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.046492 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-85fab95f-22b4-4ca3-a63f-9fa94f7397cb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.103583 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fbcfce81-d49c-4a61-a371-ca0ccb7066c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:55.104451 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fbcfce81-d49c-4a61-a371-ca0ccb7066c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:55.111745 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fbcfce81-d49c-4a61-a371-ca0ccb7066c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.112323 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fbcfce81-d49c-4a61-a371-ca0ccb7066c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.113413 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fbcfce81-d49c-4a61-a371-ca0ccb7066c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.114031 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fbcfce81-d49c-4a61-a371-ca0ccb7066c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.176159 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fbcfce81-d49c-4a61-a371-ca0ccb7066c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:55.184378 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fbcfce81-d49c-4a61-a371-ca0ccb7066c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:55.185900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fbcfce81-d49c-4a61-a371-ca0ccb7066c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:55.187101 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fbcfce81-d49c-4a61-a371-ca0ccb7066c2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1332 microversion: 2.20 time: 0.087694 Jul 18 02:39:55.187668 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 344/692] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:55 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:39:55.191957 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-85fab95f-22b4-4ca3-a63f-9fa94f7397cb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:55.199845 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-85fab95f-22b4-4ca3-a63f-9fa94f7397cb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1728 microversion: 2.1 time: 0.168934 Jul 18 02:39:55.200400 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 349/693] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:39:55 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:39:55.216764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fa0b0d62-7da9-4666-b460-c5e6387d7e5b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:55.217257 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fa0b0d62-7da9-4666-b460-c5e6387d7e5b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:55.223435 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fa0b0d62-7da9-4666-b460-c5e6387d7e5b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.223886 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fa0b0d62-7da9-4666-b460-c5e6387d7e5b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.224648 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fa0b0d62-7da9-4666-b460-c5e6387d7e5b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:55.225135 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fa0b0d62-7da9-4666-b460-c5e6387d7e5b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:55.303258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fa0b0d62-7da9-4666-b460-c5e6387d7e5b tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090216 Jul 18 02:39:55.303857 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 345/694] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 18 02:39:55 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:56.204665 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-217de5e3-240d-4ed0-81b6-7ffb60affa5c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:56.205911 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-217de5e3-240d-4ed0-81b6-7ffb60affa5c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:56.224428 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-217de5e3-240d-4ed0-81b6-7ffb60affa5c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:56.224986 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-217de5e3-240d-4ed0-81b6-7ffb60affa5c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:56.225772 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-217de5e3-240d-4ed0-81b6-7ffb60affa5c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:56.226236 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-217de5e3-240d-4ed0-81b6-7ffb60affa5c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:56.263149 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-0427de13-22c4-4daf-88eb-c40b478a7df0 req-e1a9b685-3280-46b2-bd5c-d81a563fc9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202ad2e8-7648-4965-afb6-736cb94b74ac", "tag": "b201d32b-4faf-4b5d-b867-467d2b9bcc9a"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:56.273852 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-0427de13-22c4-4daf-88eb-c40b478a7df0 req-e1a9b685-3280-46b2-bd5c-d81a563fc9d0 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:56.274350 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-0427de13-22c4-4daf-88eb-c40b478a7df0 req-e1a9b685-3280-46b2-bd5c-d81a563fc9d0 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:56.287446 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-0427de13-22c4-4daf-88eb-c40b478a7df0 req-e1a9b685-3280-46b2-bd5c-d81a563fc9d0 service nova] Creating event network-changed:b201d32b-4faf-4b5d-b867-467d2b9bcc9a for instance 202ad2e8-7648-4965-afb6-736cb94b74ac on hv-cinder-85001 Jul 18 02:39:56.292831 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-0427de13-22c4-4daf-88eb-c40b478a7df0 req-e1a9b685-3280-46b2-bd5c-d81a563fc9d0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033909 Jul 18 02:39:56.293900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 346/695] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:56.320224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-217de5e3-240d-4ed0-81b6-7ffb60affa5c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:56.326844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-217de5e3-240d-4ed0-81b6-7ffb60affa5c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:56.328384 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-217de5e3-240d-4ed0-81b6-7ffb60affa5c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:56.329525 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-217de5e3-240d-4ed0-81b6-7ffb60affa5c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1350 microversion: 2.20 time: 0.128675 Jul 18 02:39:56.330075 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 350/696] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:56 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:57.355294 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0a41e0a3-f35c-44be-867a-6b2cc22b3078 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:57.355987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0a41e0a3-f35c-44be-867a-6b2cc22b3078 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:57.362870 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0a41e0a3-f35c-44be-867a-6b2cc22b3078 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:57.363948 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0a41e0a3-f35c-44be-867a-6b2cc22b3078 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:57.364777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0a41e0a3-f35c-44be-867a-6b2cc22b3078 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:57.365231 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0a41e0a3-f35c-44be-867a-6b2cc22b3078 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:57.600984 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0a41e0a3-f35c-44be-867a-6b2cc22b3078 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:57.609703 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0a41e0a3-f35c-44be-867a-6b2cc22b3078 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:57.611245 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0a41e0a3-f35c-44be-867a-6b2cc22b3078 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:57.612382 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0a41e0a3-f35c-44be-867a-6b2cc22b3078 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1405 microversion: 2.20 time: 0.261335 Jul 18 02:39:57.612972 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 347/697] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:57 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1405 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:58.322230 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-53d090f0-a6d8-41cb-98e6-9069ba724311 req-650aefd8-b502-4f83-a4d3-c2bcabe0fb96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202ad2e8-7648-4965-afb6-736cb94b74ac", "tag": "b201d32b-4faf-4b5d-b867-467d2b9bcc9a"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:58.330588 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-53d090f0-a6d8-41cb-98e6-9069ba724311 req-650aefd8-b502-4f83-a4d3-c2bcabe0fb96 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:58.331040 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-53d090f0-a6d8-41cb-98e6-9069ba724311 req-650aefd8-b502-4f83-a4d3-c2bcabe0fb96 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:58.342919 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-53d090f0-a6d8-41cb-98e6-9069ba724311 req-650aefd8-b502-4f83-a4d3-c2bcabe0fb96 service nova] Creating event network-changed:b201d32b-4faf-4b5d-b867-467d2b9bcc9a for instance 202ad2e8-7648-4965-afb6-736cb94b74ac on hv-cinder-85001 Jul 18 02:39:58.348640 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-53d090f0-a6d8-41cb-98e6-9069ba724311 req-650aefd8-b502-4f83-a4d3-c2bcabe0fb96 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030108 Jul 18 02:39:58.349240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 351/698] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:58.460717 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-5d5348f9-6645-4b8e-a7a2-832c2003aa63 req-3117300c-4e18-4dde-bfd6-f575276660ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a", "tag": "078d1890-a0ab-46d1-ac2c-464bd6da369c"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:39:58.471437 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-5d5348f9-6645-4b8e-a7a2-832c2003aa63 req-3117300c-4e18-4dde-bfd6-f575276660ef service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:58.471979 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-5d5348f9-6645-4b8e-a7a2-832c2003aa63 req-3117300c-4e18-4dde-bfd6-f575276660ef service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:58.485372 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-5d5348f9-6645-4b8e-a7a2-832c2003aa63 req-3117300c-4e18-4dde-bfd6-f575276660ef service nova] Creating event network-changed:078d1890-a0ab-46d1-ac2c-464bd6da369c for instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a on hv-cinder-85001 Jul 18 02:39:58.491128 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-5d5348f9-6645-4b8e-a7a2-832c2003aa63 req-3117300c-4e18-4dde-bfd6-f575276660ef service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034659 Jul 18 02:39:58.492051 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 348/699] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:39:58.631275 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-de11e462-40ad-4a4a-afc4-60501a83fd20 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:58.632057 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-de11e462-40ad-4a4a-afc4-60501a83fd20 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:58.638475 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-de11e462-40ad-4a4a-afc4-60501a83fd20 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:58.639101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-de11e462-40ad-4a4a-afc4-60501a83fd20 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:58.639891 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-de11e462-40ad-4a4a-afc4-60501a83fd20 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:58.640330 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-de11e462-40ad-4a4a-afc4-60501a83fd20 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:58.781924 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-de11e462-40ad-4a4a-afc4-60501a83fd20 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:58.790700 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-de11e462-40ad-4a4a-afc4-60501a83fd20 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:58.792571 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-de11e462-40ad-4a4a-afc4-60501a83fd20 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:58.793886 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-de11e462-40ad-4a4a-afc4-60501a83fd20 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1405 microversion: 2.20 time: 0.166981 Jul 18 02:39:58.794666 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 352/700] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:58 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:39:59.813916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-32f75013-55db-44ff-9725-b16273260538 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:39:59.814532 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-32f75013-55db-44ff-9725-b16273260538 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:39:59.820809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32f75013-55db-44ff-9725-b16273260538 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:59.821257 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32f75013-55db-44ff-9725-b16273260538 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:59.822029 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32f75013-55db-44ff-9725-b16273260538 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:39:59.822493 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32f75013-55db-44ff-9725-b16273260538 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:39:59.955299 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-32f75013-55db-44ff-9725-b16273260538 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:59.963859 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-32f75013-55db-44ff-9725-b16273260538 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:59.965367 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-32f75013-55db-44ff-9725-b16273260538 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:39:59.966502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-32f75013-55db-44ff-9725-b16273260538 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1405 microversion: 2.20 time: 0.157376 Jul 18 02:39:59.967075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 349/701] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:39:59 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:00.983650 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-483837c8-d591-41ff-a4bc-f6066608a6e0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:00.984296 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-483837c8-d591-41ff-a4bc-f6066608a6e0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:00.991124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-483837c8-d591-41ff-a4bc-f6066608a6e0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:00.991574 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-483837c8-d591-41ff-a4bc-f6066608a6e0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:00.992372 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-483837c8-d591-41ff-a4bc-f6066608a6e0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:00.992810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-483837c8-d591-41ff-a4bc-f6066608a6e0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:01.234354 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-483837c8-d591-41ff-a4bc-f6066608a6e0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:01.242267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-483837c8-d591-41ff-a4bc-f6066608a6e0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:01.243758 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-483837c8-d591-41ff-a4bc-f6066608a6e0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:01.244843 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-483837c8-d591-41ff-a4bc-f6066608a6e0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1405 microversion: 2.20 time: 0.265114 Jul 18 02:40:01.245399 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 353/702] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:00 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:02.263370 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6c6a1240-e11f-4370-ae95-e941dc2436b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:02.264151 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6c6a1240-e11f-4370-ae95-e941dc2436b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:02.266724 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:02.272224 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6c6a1240-e11f-4370-ae95-e941dc2436b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:02.272675 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6c6a1240-e11f-4370-ae95-e941dc2436b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:02.273461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6c6a1240-e11f-4370-ae95-e941dc2436b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:02.273897 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6c6a1240-e11f-4370-ae95-e941dc2436b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:02.454808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6c6a1240-e11f-4370-ae95-e941dc2436b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:02.463087 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6c6a1240-e11f-4370-ae95-e941dc2436b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:02.464585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6c6a1240-e11f-4370-ae95-e941dc2436b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:02.465720 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6c6a1240-e11f-4370-ae95-e941dc2436b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1405 microversion: 2.20 time: 0.206236 Jul 18 02:40:02.466307 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 350/703] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:02 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:03.483658 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bcca57ea-67d9-49cc-8374-b6e0dd418281 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:03.484833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bcca57ea-67d9-49cc-8374-b6e0dd418281 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:03.487081 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:03.487880 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=10 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:03.493127 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bcca57ea-67d9-49cc-8374-b6e0dd418281 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:03.493583 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bcca57ea-67d9-49cc-8374-b6e0dd418281 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:03.494388 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bcca57ea-67d9-49cc-8374-b6e0dd418281 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:03.494827 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bcca57ea-67d9-49cc-8374-b6e0dd418281 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:03.627672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bcca57ea-67d9-49cc-8374-b6e0dd418281 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:03.636852 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bcca57ea-67d9-49cc-8374-b6e0dd418281 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:03.638420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bcca57ea-67d9-49cc-8374-b6e0dd418281 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:03.639526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bcca57ea-67d9-49cc-8374-b6e0dd418281 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1405 microversion: 2.20 time: 0.159740 Jul 18 02:40:03.640093 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 354/704] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:03 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:03.707066 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-0eb9b19e-721f-460e-adf8-a8779dfdab4f req-4a642642-d442-41df-b00e-d517752fa2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a", "name": "network-vif-plugged", "status": "completed", "tag": "078d1890-a0ab-46d1-ac2c-464bd6da369c"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:03.715933 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-0eb9b19e-721f-460e-adf8-a8779dfdab4f req-4a642642-d442-41df-b00e-d517752fa2b4 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:03.716379 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-0eb9b19e-721f-460e-adf8-a8779dfdab4f req-4a642642-d442-41df-b00e-d517752fa2b4 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:03.719986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:03.727072 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-0eb9b19e-721f-460e-adf8-a8779dfdab4f req-4a642642-d442-41df-b00e-d517752fa2b4 service nova] Creating event network-vif-plugged:078d1890-a0ab-46d1-ac2c-464bd6da369c for instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a on hv-cinder-85001 Jul 18 02:40:03.733453 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-0eb9b19e-721f-460e-adf8-a8779dfdab4f req-4a642642-d442-41df-b00e-d517752fa2b4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028708 Jul 18 02:40:03.733453 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 351/705] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:04.657110 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d6b677d4-1157-415f-ac8a-0316d889f31c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:04.657774 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d6b677d4-1157-415f-ac8a-0316d889f31c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:04.665071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d6b677d4-1157-415f-ac8a-0316d889f31c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:04.665516 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d6b677d4-1157-415f-ac8a-0316d889f31c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:04.666343 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d6b677d4-1157-415f-ac8a-0316d889f31c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:04.666779 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d6b677d4-1157-415f-ac8a-0316d889f31c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:04.796962 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d6b677d4-1157-415f-ac8a-0316d889f31c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:04.805149 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d6b677d4-1157-415f-ac8a-0316d889f31c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:04.806682 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d6b677d4-1157-415f-ac8a-0316d889f31c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:04.807793 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d6b677d4-1157-415f-ac8a-0316d889f31c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1405 microversion: 2.20 time: 0.154582 Jul 18 02:40:04.808348 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 355/706] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:04 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:05.827311 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ecf45500-28a7-4f28-9789-ed1a0f564cae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:05.828028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ecf45500-28a7-4f28-9789-ed1a0f564cae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:05.835325 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ecf45500-28a7-4f28-9789-ed1a0f564cae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:05.835778 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ecf45500-28a7-4f28-9789-ed1a0f564cae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:05.836545 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ecf45500-28a7-4f28-9789-ed1a0f564cae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:05.836982 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ecf45500-28a7-4f28-9789-ed1a0f564cae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:05.964401 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ecf45500-28a7-4f28-9789-ed1a0f564cae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:05.972272 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ecf45500-28a7-4f28-9789-ed1a0f564cae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:05.973946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ecf45500-28a7-4f28-9789-ed1a0f564cae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:05.975121 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ecf45500-28a7-4f28-9789-ed1a0f564cae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1597 microversion: 2.20 time: 0.153026 Jul 18 02:40:05.975677 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 352/707] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:05 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1597 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:05.992243 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3d35df48-a330-4281-9e66-2b5fa9f5f403 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:05.992766 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3d35df48-a330-4281-9e66-2b5fa9f5f403 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:05.999327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d35df48-a330-4281-9e66-2b5fa9f5f403 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:05.999808 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d35df48-a330-4281-9e66-2b5fa9f5f403 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:06.000575 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d35df48-a330-4281-9e66-2b5fa9f5f403 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:06.001013 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d35df48-a330-4281-9e66-2b5fa9f5f403 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:06.017820 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:06.078492 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3d35df48-a330-4281-9e66-2b5fa9f5f403 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090104 Jul 18 02:40:06.079214 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 356/708] 10.222.0.66 () {60 vars in 1315 bytes} [Mon Jul 18 02:40:05 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:40:07.273152 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-f0b7f192-192c-4885-8156-bd8ef5909f13 req-b767029b-b6f4-4d56-aa36-da69f89b9472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a", "tag": "078d1890-a0ab-46d1-ac2c-464bd6da369c"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:07.281987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-f0b7f192-192c-4885-8156-bd8ef5909f13 req-b767029b-b6f4-4d56-aa36-da69f89b9472 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:07.282484 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-f0b7f192-192c-4885-8156-bd8ef5909f13 req-b767029b-b6f4-4d56-aa36-da69f89b9472 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:07.295856 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-f0b7f192-192c-4885-8156-bd8ef5909f13 req-b767029b-b6f4-4d56-aa36-da69f89b9472 service nova] Creating event network-changed:078d1890-a0ab-46d1-ac2c-464bd6da369c for instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a on hv-cinder-85001 Jul 18 02:40:07.300759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-f0b7f192-192c-4885-8156-bd8ef5909f13 req-b767029b-b6f4-4d56-aa36-da69f89b9472 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032425 Jul 18 02:40:07.301855 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 353/709] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:11.578394 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-93926fdd-e512-43cf-a9e1-6924356d1078 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:11.579011 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-93926fdd-e512-43cf-a9e1-6924356d1078 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:11.580669 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:11.585727 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-93926fdd-e512-43cf-a9e1-6924356d1078 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:11.586214 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-93926fdd-e512-43cf-a9e1-6924356d1078 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:11.586977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-93926fdd-e512-43cf-a9e1-6924356d1078 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:11.587413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-93926fdd-e512-43cf-a9e1-6924356d1078 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:11.612370 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-93926fdd-e512-43cf-a9e1-6924356d1078 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/ips" status: 200 len: 149 microversion: 2.1 time: 0.038109 Jul 18 02:40:11.612576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 357/710] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 18 02:40:11 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:12.112069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-04ed3bbe-a123-4d1e-bef6-a555b6433c3f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:12.113086 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-04ed3bbe-a123-4d1e-bef6-a555b6433c3f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:12.119895 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-04ed3bbe-a123-4d1e-bef6-a555b6433c3f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:12.120338 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-04ed3bbe-a123-4d1e-bef6-a555b6433c3f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:12.121115 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-04ed3bbe-a123-4d1e-bef6-a555b6433c3f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:12.121541 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-04ed3bbe-a123-4d1e-bef6-a555b6433c3f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:12.157060 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-04ed3bbe-a123-4d1e-bef6-a555b6433c3f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049680 Jul 18 02:40:12.157644 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 354/711] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:40:12 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:40:12.365282 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-efdac1ad-32e8-4893-a4a3-b746c9dce1c6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:12.365923 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-efdac1ad-32e8-4893-a4a3-b746c9dce1c6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:12.373018 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-efdac1ad-32e8-4893-a4a3-b746c9dce1c6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:12.373475 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-efdac1ad-32e8-4893-a4a3-b746c9dce1c6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:12.374281 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-efdac1ad-32e8-4893-a4a3-b746c9dce1c6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:12.374728 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-efdac1ad-32e8-4893-a4a3-b746c9dce1c6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:12.400799 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-efdac1ad-32e8-4893-a4a3-b746c9dce1c6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Going to try to terminate instance {{(pid=124890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:40:12.793808 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-efdac1ad-32e8-4893-a4a3-b746c9dce1c6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 204 len: 0 microversion: 2.1 time: 0.433462 Jul 18 02:40:12.794534 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 358/712] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:40:12 2022] DELETE /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:40:12.804288 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cd5bb137-8f1a-4c3c-90fb-dd68c05411f8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:12.808545 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-cd5bb137-8f1a-4c3c-90fb-dd68c05411f8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:12.811039 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd5bb137-8f1a-4c3c-90fb-dd68c05411f8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:12.811550 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd5bb137-8f1a-4c3c-90fb-dd68c05411f8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:12.812320 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd5bb137-8f1a-4c3c-90fb-dd68c05411f8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:12.812768 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd5bb137-8f1a-4c3c-90fb-dd68c05411f8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:12.944963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-cd5bb137-8f1a-4c3c-90fb-dd68c05411f8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:12.952694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-cd5bb137-8f1a-4c3c-90fb-dd68c05411f8 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1673 microversion: 2.1 time: 0.153917 Jul 18 02:40:12.953268 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 355/713] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:12 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:13.365469 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a4bb1424-0712-4c70-8201-00d849ca4c88 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2378b43b-8aae-424b-8a4d-40aa7bfdb051"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:13.367137 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a4bb1424-0712-4c70-8201-00d849ca4c88 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:13.372639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4bb1424-0712-4c70-8201-00d849ca4c88 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:13.373083 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4bb1424-0712-4c70-8201-00d849ca4c88 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:13.373849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4bb1424-0712-4c70-8201-00d849ca4c88 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:13.374317 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4bb1424-0712-4c70-8201-00d849ca4c88 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:13.970296 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ce20878a-6ae1-4264-b187-9391d1e33987 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:13.970930 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ce20878a-6ae1-4264-b187-9391d1e33987 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:13.977524 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ce20878a-6ae1-4264-b187-9391d1e33987 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:13.978022 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ce20878a-6ae1-4264-b187-9391d1e33987 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:13.978844 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ce20878a-6ae1-4264-b187-9391d1e33987 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:13.979283 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ce20878a-6ae1-4264-b187-9391d1e33987 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:14.110518 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ce20878a-6ae1-4264-b187-9391d1e33987 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:14.115425 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ce20878a-6ae1-4264-b187-9391d1e33987 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1673 microversion: 2.1 time: 0.148914 Jul 18 02:40:14.116029 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 356/714] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:13 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:15.133284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0b4243e9-ce69-40df-ada9-57c6a5a25a55 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:15.134162 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0b4243e9-ce69-40df-ada9-57c6a5a25a55 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:15.140888 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b4243e9-ce69-40df-ada9-57c6a5a25a55 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:15.141343 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b4243e9-ce69-40df-ada9-57c6a5a25a55 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:15.142135 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b4243e9-ce69-40df-ada9-57c6a5a25a55 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:15.142625 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b4243e9-ce69-40df-ada9-57c6a5a25a55 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:15.349955 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a4bb1424-0712-4c70-8201-00d849ca4c88 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.988881 Jul 18 02:40:15.354051 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 359/715] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:40:13 2022] POST /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments => generated 194 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:15.369542 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0b4243e9-ce69-40df-ada9-57c6a5a25a55 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:15.379936 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0b4243e9-ce69-40df-ada9-57c6a5a25a55 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1673 microversion: 2.1 time: 0.251110 Jul 18 02:40:15.381761 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 357/716] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:15 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1673 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:16.085703 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-32a44a24-0e5a-4a96-b0b9-0c9be1868aab req-6906e03a-4f81-413c-81d4-ff98b1f6496a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1905a0-2c49-40f1-921a-0fda9997cdb3", "name": "network-vif-deleted", "tag": "f7b04923-0911-4df9-b770-512e41d840f9"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:16.094019 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-32a44a24-0e5a-4a96-b0b9-0c9be1868aab req-6906e03a-4f81-413c-81d4-ff98b1f6496a service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:16.098283 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-32a44a24-0e5a-4a96-b0b9-0c9be1868aab req-6906e03a-4f81-413c-81d4-ff98b1f6496a service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:16.105658 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-32a44a24-0e5a-4a96-b0b9-0c9be1868aab req-6906e03a-4f81-413c-81d4-ff98b1f6496a service nova] Creating event network-vif-deleted:f7b04923-0911-4df9-b770-512e41d840f9 for instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 on hv-cinder-85001 Jul 18 02:40:16.110647 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-32a44a24-0e5a-4a96-b0b9-0c9be1868aab req-6906e03a-4f81-413c-81d4-ff98b1f6496a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030153 Jul 18 02:40:16.111684 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 360/717] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:16.216308 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:40:16.216965 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Mon Jul 18 02:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:40:16.404626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e6fce4a1-8179-48ed-81bb-9aa28787b652 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:16.405898 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e6fce4a1-8179-48ed-81bb-9aa28787b652 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:16.413383 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e6fce4a1-8179-48ed-81bb-9aa28787b652 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:16.420014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e6fce4a1-8179-48ed-81bb-9aa28787b652 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:16.420014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e6fce4a1-8179-48ed-81bb-9aa28787b652 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:16.420014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e6fce4a1-8179-48ed-81bb-9aa28787b652 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:16.485804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e6fce4a1-8179-48ed-81bb-9aa28787b652 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:16.495890 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e6fce4a1-8179-48ed-81bb-9aa28787b652 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 200 len: 1322 microversion: 2.1 time: 0.096196 Jul 18 02:40:16.496745 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 358/718] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:16 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 1322 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:17.519732 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-12b622cc-428e-4cc7-9f0e-06317acf5f77 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:17.521262 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-12b622cc-428e-4cc7-9f0e-06317acf5f77 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:17.528091 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-12b622cc-428e-4cc7-9f0e-06317acf5f77 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:17.528551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-12b622cc-428e-4cc7-9f0e-06317acf5f77 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:17.529366 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-12b622cc-428e-4cc7-9f0e-06317acf5f77 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:17.529806 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-12b622cc-428e-4cc7-9f0e-06317acf5f77 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:17.544584 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-12b622cc-428e-4cc7-9f0e-06317acf5f77 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] HTTP exception thrown: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-12b622cc-428e-4cc7-9f0e-06317acf5f77 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Request method failure captured: Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 HTTP/1.1 Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbfsUQCN5ay0wbB5exK1DXcdeD5aEED-ii59UVtO8NLEKzDf9s38DmNdG2mXY5zznMhqdDd5IqQiSnZIg74LbTn5ykm1o82q5ChmmwPVUPTWePMXG6lmdY3pPLDvDIu7qPgudsnNRSM4NGb3C_U47Ymyh3fTyxAVRFXIaM4IGa4lwY Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:40:17.546437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_85204e1ae6844b70b45f8452887d5385", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 879f7a4cf6664e76bddffc804658b250 Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:40:17.548106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '6e1905a0-2c49-40f1-921a-0fda9997cdb3'} Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:40:17.549078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:40:17.550643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:17.552545 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-12b622cc-428e-4cc7-9f0e-06317acf5f77 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Returning 404 to user: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:40:17.552545 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-12b622cc-428e-4cc7-9f0e-06317acf5f77 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 404 len: 111 microversion: 2.1 time: 0.033156 Jul 18 02:40:17.552545 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 361/719] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:17 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:40:17.557738 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-64a0f7ce-8fdc-458e-9a9c-6abea2ee9a2d tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '.version_select at 0x7f28ee51a1f0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:17.689401 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-64a0f7ce-8fdc-458e-9a9c-6abea2ee9a2d tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-756383081" status: 202 len: 0 microversion: 2.1 time: 0.135879 Jul 18 02:40:17.689982 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 359/720] 10.222.0.66 () {58 vars in 1217 bytes} [Mon Jul 18 02:40:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-756383081 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:40:18.455155 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3208f423-e7e2-47aa-b56f-66044828cb50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'create', calling method: .version_select at 0x7f28edd1c1f0>, body: {"keypair": {"name": "tempest-keypair-1071967315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2+R8I1a42m+lgr3xkvDEQrpNV/7F4R4YljN0PLjFJB9TlkMRbFzxhJife4yz4viUqOv89WjfJir7xfTgkkOqs5Aii8nqWCTVIJLRcW4JlQmQXHUYrbmS20iKJcKq1bkw=="}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:18.469077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-3208f423-e7e2-47aa-b56f-66044828cb50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Getting quotas for project 85204e1ae6844b70b45f8452887d5385. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:18.472840 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-3208f423-e7e2-47aa-b56f-66044828cb50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Getting quotas for user 879f7a4cf6664e76bddffc804658b250 and project 85204e1ae6844b70b45f8452887d5385. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:18.592120 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3208f423-e7e2-47aa-b56f-66044828cb50 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140821 Jul 18 02:40:18.592726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 362/721] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 18 02:40:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:21.084153 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-979887477", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69054a80-8318-40e4-bbcb-fa67a0902b79"}], "security_groups": [{"name": "tempest-securitygroup--2119052369"}], "key_name": "tempest-keypair-1071967315", "user_data": "}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:21.187939 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] validate_networks() for [('69054a80-8318-40e4-bbcb-fa67a0902b79', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:40:21.599046 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:40:21.599466 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:40:21.599969 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:40:21.600577 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:40:21.600990 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:40:21.610146 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:21.610602 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:21.611395 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:21.611882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:21.628174 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Getting quotas for project 85204e1ae6844b70b45f8452887d5385. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:21.632701 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Getting quotas for user 879f7a4cf6664e76bddffc804658b250 and project 85204e1ae6844b70b45f8452887d5385. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:21.643484 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:40:21.646453 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:40:21.817932 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-94f632a4-6712-4ebf-a0ff-7faa18716eea tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.738626 Jul 18 02:40:21.818598 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 360/722] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:40:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:40:21.834595 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-95f77f68-a042-48d6-95f4-eb58f2ea057f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:21.835203 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-95f77f68-a042-48d6-95f4-eb58f2ea057f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:21.890573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-95f77f68-a042-48d6-95f4-eb58f2ea057f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:21.897409 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-95f77f68-a042-48d6-95f4-eb58f2ea057f tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1237 microversion: 2.1 time: 0.067817 Jul 18 02:40:21.897977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 363/723] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:21 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:22.915130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c138380d-5e31-49fc-b95a-652a8bb4ef98 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:22.915713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c138380d-5e31-49fc-b95a-652a8bb4ef98 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:22.921820 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c138380d-5e31-49fc-b95a-652a8bb4ef98 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:22.922308 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c138380d-5e31-49fc-b95a-652a8bb4ef98 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:22.923067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c138380d-5e31-49fc-b95a-652a8bb4ef98 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:22.925394 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c138380d-5e31-49fc-b95a-652a8bb4ef98 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:22.990021 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c138380d-5e31-49fc-b95a-652a8bb4ef98 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:22.996374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c138380d-5e31-49fc-b95a-652a8bb4ef98 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1241 microversion: 2.1 time: 0.086224 Jul 18 02:40:22.996950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 361/724] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:22 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:23.977690 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-426d7bb7-33e7-4d54-8ccd-6c2697fabcee tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2378b43b-8aae-424b-8a4d-40aa7bfdb051"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:23.978800 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-426d7bb7-33e7-4d54-8ccd-6c2697fabcee tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:23.985441 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-426d7bb7-33e7-4d54-8ccd-6c2697fabcee tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:23.985893 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-426d7bb7-33e7-4d54-8ccd-6c2697fabcee tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:23.986707 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-426d7bb7-33e7-4d54-8ccd-6c2697fabcee tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:23.987149 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-426d7bb7-33e7-4d54-8ccd-6c2697fabcee tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:24.013830 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5016e1bd-f682-4366-82d9-e1d9a1c725f6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:24.014626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5016e1bd-f682-4366-82d9-e1d9a1c725f6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:24.017343 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:24.022824 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5016e1bd-f682-4366-82d9-e1d9a1c725f6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:24.023277 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5016e1bd-f682-4366-82d9-e1d9a1c725f6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:24.024183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5016e1bd-f682-4366-82d9-e1d9a1c725f6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:24.024687 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5016e1bd-f682-4366-82d9-e1d9a1c725f6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:24.071190 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-426d7bb7-33e7-4d54-8ccd-6c2697fabcee tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Invalid volume: volume 2378b43b-8aae-424b-8a4d-40aa7bfdb051 is already attached to instances: 5530cea9-7344-405e-bf59-9d4f629dddbc Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-426d7bb7-33e7-4d54-8ccd-6c2697fabcee tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: POST /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments HTTP/1.1 Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 74 Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:40:24.073210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {"volumeAttachment": {"volumeId": "2378b43b-8aae-424b-8a4d-40aa7bfdb051"}} Jul 18 02:40:24.075130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Invalid volume: volume 2378b43b-8aae-424b-8a4d-40aa7bfdb051 is already attached to instances: 5530cea9-7344-405e-bf59-9d4f629dddbc Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'server_id': '5530cea9-7344-405e-bf59-9d4f629dddbc', 'body': {'volumeAttachment': {'volumeId': '2378b43b-8aae-424b-8a4d-40aa7bfdb051'}}} Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2378b43b-8aae-424b-8a4d-40aa7bfdb051 is already attached to instances: 5530cea9-7344-405e-bf59-9d4f629dddbc Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:24.076101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2378b43b-8aae-424b-8a4d-40aa7bfdb051 is already attached to instances: 5530cea9-7344-405e-bf59-9d4f629dddbc Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:24.077448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:24.080065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:24.080065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:40:24.080065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:40:24.080065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2378b43b-8aae-424b-8a4d-40aa7bfdb051 is already attached to instances: 5530cea9-7344-405e-bf59-9d4f629dddbc Jul 18 02:40:24.080065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:24.080065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-426d7bb7-33e7-4d54-8ccd-6c2697fabcee tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 400 to user: Invalid volume: volume 2378b43b-8aae-424b-8a4d-40aa7bfdb051 is already attached to instances: 5530cea9-7344-405e-bf59-9d4f629dddbc {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:40:24.080065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-426d7bb7-33e7-4d54-8ccd-6c2697fabcee tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102298 Jul 18 02:40:24.080065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 364/725] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:40:23 2022] POST /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:40:24.110346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5016e1bd-f682-4366-82d9-e1d9a1c725f6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:24.122328 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5016e1bd-f682-4366-82d9-e1d9a1c725f6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1297 microversion: 2.1 time: 0.112054 Jul 18 02:40:24.123220 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 362/726] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:24 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1297 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:24.140056 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a4590417-35f1-47e4-82fd-3a99d4fc43fa tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:24.140576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a4590417-35f1-47e4-82fd-3a99d4fc43fa tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:24.148529 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4590417-35f1-47e4-82fd-3a99d4fc43fa tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:24.148982 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4590417-35f1-47e4-82fd-3a99d4fc43fa tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:24.149754 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4590417-35f1-47e4-82fd-3a99d4fc43fa tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:24.150262 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4590417-35f1-47e4-82fd-3a99d4fc43fa tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:24.237599 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-a4590417-35f1-47e4-82fd-3a99d4fc43fa tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lazy-loading 'services' on Instance uuid 5530cea9-7344-405e-bf59-9d4f629dddbc {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:40:24.539956 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a4590417-35f1-47e4-82fd-3a99d4fc43fa tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments/2378b43b-8aae-424b-8a4d-40aa7bfdb051" status: 202 len: 0 microversion: 2.1 time: 0.403630 Jul 18 02:40:24.540742 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 365/727] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:40:24 2022] DELETE /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments/2378b43b-8aae-424b-8a4d-40aa7bfdb051 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:40:24.549444 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bd9abc62-1486-4532-9105-1f9276f5ee11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:24.550507 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bd9abc62-1486-4532-9105-1f9276f5ee11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:24.558222 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd9abc62-1486-4532-9105-1f9276f5ee11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:24.558814 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd9abc62-1486-4532-9105-1f9276f5ee11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:24.559650 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd9abc62-1486-4532-9105-1f9276f5ee11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:24.560053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd9abc62-1486-4532-9105-1f9276f5ee11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:24.588678 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bd9abc62-1486-4532-9105-1f9276f5ee11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Jul 18 02:40:24.589250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 363/728] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:40:24 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:25.140908 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-00539c2c-9b38-46e8-8763-6b8de49df893 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:25.143939 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-00539c2c-9b38-46e8-8763-6b8de49df893 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:25.148618 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00539c2c-9b38-46e8-8763-6b8de49df893 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:25.149098 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00539c2c-9b38-46e8-8763-6b8de49df893 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:25.149864 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00539c2c-9b38-46e8-8763-6b8de49df893 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:25.150335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00539c2c-9b38-46e8-8763-6b8de49df893 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:25.292307 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-00539c2c-9b38-46e8-8763-6b8de49df893 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:25.299993 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-00539c2c-9b38-46e8-8763-6b8de49df893 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1363 microversion: 2.1 time: 0.163635 Jul 18 02:40:25.300570 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 366/729] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:25 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:25.601221 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-319d51a9-6449-4d45-9ad5-b45b97e1ecb0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:25.602199 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-319d51a9-6449-4d45-9ad5-b45b97e1ecb0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:25.608971 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-319d51a9-6449-4d45-9ad5-b45b97e1ecb0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:25.609528 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-319d51a9-6449-4d45-9ad5-b45b97e1ecb0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:25.610330 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-319d51a9-6449-4d45-9ad5-b45b97e1ecb0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:25.610773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-319d51a9-6449-4d45-9ad5-b45b97e1ecb0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:25.652034 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-319d51a9-6449-4d45-9ad5-b45b97e1ecb0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055359 Jul 18 02:40:25.656357 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 364/730] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:40:25 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:25.962052 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-a3adba3a-9727-4062-8a89-e6b42cbbbb49 req-f046490f-c080-4206-bf13-c04cfd9fb805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2211074-6d69-4b22-b254-ea00a4ecc4c6", "tag": "88e1f36a-f13d-4fe9-af74-bfa7d331b96a"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:25.974419 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-a3adba3a-9727-4062-8a89-e6b42cbbbb49 req-f046490f-c080-4206-bf13-c04cfd9fb805 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:25.974860 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-a3adba3a-9727-4062-8a89-e6b42cbbbb49 req-f046490f-c080-4206-bf13-c04cfd9fb805 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:25.987627 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-a3adba3a-9727-4062-8a89-e6b42cbbbb49 req-f046490f-c080-4206-bf13-c04cfd9fb805 service nova] Creating event network-changed:88e1f36a-f13d-4fe9-af74-bfa7d331b96a for instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 on hv-cinder-85001 Jul 18 02:40:25.993622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-a3adba3a-9727-4062-8a89-e6b42cbbbb49 req-f046490f-c080-4206-bf13-c04cfd9fb805 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039004 Jul 18 02:40:25.994313 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 367/731] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:26.318563 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-73c28e98-8efe-440e-ad4f-8f9afd5bc5f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:26.319182 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-73c28e98-8efe-440e-ad4f-8f9afd5bc5f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:26.325327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73c28e98-8efe-440e-ad4f-8f9afd5bc5f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.325783 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73c28e98-8efe-440e-ad4f-8f9afd5bc5f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.326620 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73c28e98-8efe-440e-ad4f-8f9afd5bc5f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.327054 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-73c28e98-8efe-440e-ad4f-8f9afd5bc5f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.498186 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-73c28e98-8efe-440e-ad4f-8f9afd5bc5f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:26.506154 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-73c28e98-8efe-440e-ad4f-8f9afd5bc5f1 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1363 microversion: 2.1 time: 0.192102 Jul 18 02:40:26.506726 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 365/732] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:26 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:26.664338 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0773410f-dffc-4666-8ab4-cd7885c0fdba tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:26.665351 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0773410f-dffc-4666-8ab4-cd7885c0fdba tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:26.672041 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0773410f-dffc-4666-8ab4-cd7885c0fdba tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.672500 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0773410f-dffc-4666-8ab4-cd7885c0fdba tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.673265 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0773410f-dffc-4666-8ab4-cd7885c0fdba tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.673696 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0773410f-dffc-4666-8ab4-cd7885c0fdba tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.705140 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0773410f-dffc-4666-8ab4-cd7885c0fdba tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045052 Jul 18 02:40:26.705903 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 368/733] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:40:26 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:40:26.767957 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b37ab4c3-d40d-49db-b1b4-ee1e3565afc2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:26.768478 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b37ab4c3-d40d-49db-b1b4-ee1e3565afc2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:26.775731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b37ab4c3-d40d-49db-b1b4-ee1e3565afc2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.776182 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b37ab4c3-d40d-49db-b1b4-ee1e3565afc2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.776964 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b37ab4c3-d40d-49db-b1b4-ee1e3565afc2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:26.777402 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b37ab4c3-d40d-49db-b1b4-ee1e3565afc2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:26.802961 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b37ab4c3-d40d-49db-b1b4-ee1e3565afc2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:40:27.134182 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b37ab4c3-d40d-49db-b1b4-ee1e3565afc2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 204 len: 0 microversion: 2.1 time: 0.369762 Jul 18 02:40:27.134718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 366/734] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:40:26 2022] DELETE /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:40:27.142736 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7f9a2595-e729-43b9-aaa7-5a6f31bc9053 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:27.154143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7f9a2595-e729-43b9-aaa7-5a6f31bc9053 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:27.154143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7f9a2595-e729-43b9-aaa7-5a6f31bc9053 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:27.154143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7f9a2595-e729-43b9-aaa7-5a6f31bc9053 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:27.154143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7f9a2595-e729-43b9-aaa7-5a6f31bc9053 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:27.154649 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7f9a2595-e729-43b9-aaa7-5a6f31bc9053 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:27.281285 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7f9a2595-e729-43b9-aaa7-5a6f31bc9053 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:27.289317 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7f9a2595-e729-43b9-aaa7-5a6f31bc9053 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1680 microversion: 2.1 time: 0.150353 Jul 18 02:40:27.289889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 369/735] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:27 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:27.523343 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-07188739-247d-42bd-a5a4-0d725894a946 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:27.524040 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-07188739-247d-42bd-a5a4-0d725894a946 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:27.530056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-07188739-247d-42bd-a5a4-0d725894a946 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:27.530540 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-07188739-247d-42bd-a5a4-0d725894a946 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:27.531311 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-07188739-247d-42bd-a5a4-0d725894a946 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:27.531781 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-07188739-247d-42bd-a5a4-0d725894a946 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:27.662689 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-07188739-247d-42bd-a5a4-0d725894a946 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:27.669973 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-07188739-247d-42bd-a5a4-0d725894a946 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1363 microversion: 2.1 time: 0.150957 Jul 18 02:40:27.670571 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 367/736] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:27 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:28.307718 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-52f77dd0-9dba-472c-8bf0-71ff5890ca95 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:28.308362 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-52f77dd0-9dba-472c-8bf0-71ff5890ca95 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:28.314903 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-52f77dd0-9dba-472c-8bf0-71ff5890ca95 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:28.315355 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-52f77dd0-9dba-472c-8bf0-71ff5890ca95 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:28.316122 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-52f77dd0-9dba-472c-8bf0-71ff5890ca95 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:28.316563 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-52f77dd0-9dba-472c-8bf0-71ff5890ca95 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:28.445197 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-52f77dd0-9dba-472c-8bf0-71ff5890ca95 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:28.452527 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-52f77dd0-9dba-472c-8bf0-71ff5890ca95 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1680 microversion: 2.1 time: 0.149010 Jul 18 02:40:28.453086 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 370/737] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:28 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:28.687891 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-adec6a3f-0fb5-4b2a-bc2c-350f692540d4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:28.688534 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-adec6a3f-0fb5-4b2a-bc2c-350f692540d4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:28.695651 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-adec6a3f-0fb5-4b2a-bc2c-350f692540d4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:28.696190 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-adec6a3f-0fb5-4b2a-bc2c-350f692540d4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:28.696959 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-adec6a3f-0fb5-4b2a-bc2c-350f692540d4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:28.697400 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-adec6a3f-0fb5-4b2a-bc2c-350f692540d4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:28.830601 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-adec6a3f-0fb5-4b2a-bc2c-350f692540d4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:28.838937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-adec6a3f-0fb5-4b2a-bc2c-350f692540d4 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1363 microversion: 2.1 time: 0.155015 Jul 18 02:40:28.841028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 368/738] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:28 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:29.469547 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-00af62d4-14bd-4288-8fe9-1601193a1d11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:29.470188 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-00af62d4-14bd-4288-8fe9-1601193a1d11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:29.476676 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00af62d4-14bd-4288-8fe9-1601193a1d11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:29.477123 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00af62d4-14bd-4288-8fe9-1601193a1d11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:29.477886 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00af62d4-14bd-4288-8fe9-1601193a1d11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:29.478344 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00af62d4-14bd-4288-8fe9-1601193a1d11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:29.612256 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-00af62d4-14bd-4288-8fe9-1601193a1d11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:29.622155 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-00af62d4-14bd-4288-8fe9-1601193a1d11 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1680 microversion: 2.1 time: 0.156594 Jul 18 02:40:29.622730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 371/739] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:29 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:29.855977 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d88da822-ba5f-4724-857c-8eb0a51e4940 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:29.856588 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d88da822-ba5f-4724-857c-8eb0a51e4940 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:29.863377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d88da822-ba5f-4724-857c-8eb0a51e4940 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:29.863949 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d88da822-ba5f-4724-857c-8eb0a51e4940 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:29.865434 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d88da822-ba5f-4724-857c-8eb0a51e4940 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:29.865878 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d88da822-ba5f-4724-857c-8eb0a51e4940 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:29.871079 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:30.084243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d88da822-ba5f-4724-857c-8eb0a51e4940 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:30.093100 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d88da822-ba5f-4724-857c-8eb0a51e4940 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1363 microversion: 2.1 time: 0.240479 Jul 18 02:40:30.102875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 369/740] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:29 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:30.640331 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fe934f80-747b-42b3-abe3-86f84d69987e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:30.640975 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fe934f80-747b-42b3-abe3-86f84d69987e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:30.648084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe934f80-747b-42b3-abe3-86f84d69987e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:30.648537 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe934f80-747b-42b3-abe3-86f84d69987e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:30.649313 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe934f80-747b-42b3-abe3-86f84d69987e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:30.649751 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fe934f80-747b-42b3-abe3-86f84d69987e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:30.713124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fe934f80-747b-42b3-abe3-86f84d69987e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:30.720836 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fe934f80-747b-42b3-abe3-86f84d69987e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1612 microversion: 2.1 time: 0.084648 Jul 18 02:40:30.721412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 372/741] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:30 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1612 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:30.860741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-78b3bf1c-a8db-4af9-9819-55558d5006c2 req-dbd54e38-baf2-41a4-a471-c8d4625e253f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5530cea9-7344-405e-bf59-9d4f629dddbc", "name": "network-vif-deleted", "tag": "83d3e4fd-d88a-4c8f-85f4-86112f998a96"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:30.871107 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-78b3bf1c-a8db-4af9-9819-55558d5006c2 req-dbd54e38-baf2-41a4-a471-c8d4625e253f service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:30.879767 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-78b3bf1c-a8db-4af9-9819-55558d5006c2 req-dbd54e38-baf2-41a4-a471-c8d4625e253f service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:30.883486 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-78b3bf1c-a8db-4af9-9819-55558d5006c2 req-dbd54e38-baf2-41a4-a471-c8d4625e253f service nova] Creating event network-vif-deleted:83d3e4fd-d88a-4c8f-85f4-86112f998a96 for instance 5530cea9-7344-405e-bf59-9d4f629dddbc on hv-cinder-85001 Jul 18 02:40:30.888318 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-78b3bf1c-a8db-4af9-9819-55558d5006c2 req-dbd54e38-baf2-41a4-a471-c8d4625e253f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031433 Jul 18 02:40:30.888911 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 370/742] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:31.110490 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-367ad063-51b4-4948-84d9-40b8d26b14f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:31.111139 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-367ad063-51b4-4948-84d9-40b8d26b14f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:31.117230 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-367ad063-51b4-4948-84d9-40b8d26b14f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:31.117903 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-367ad063-51b4-4948-84d9-40b8d26b14f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:31.118728 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-367ad063-51b4-4948-84d9-40b8d26b14f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:31.119157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-367ad063-51b4-4948-84d9-40b8d26b14f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:31.251109 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-367ad063-51b4-4948-84d9-40b8d26b14f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:31.259297 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-367ad063-51b4-4948-84d9-40b8d26b14f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1363 microversion: 2.1 time: 0.152639 Jul 18 02:40:31.259917 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 373/743] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:31 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:31.735148 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:31.736314 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=6 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:31.740948 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:31.741725 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:31.748115 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:31.748530 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:31.749305 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:31.749744 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:31.784398 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:31.784853 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:31.785319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lazy-loading 'fault' on Instance uuid 5530cea9-7344-405e-bf59-9d4f629dddbc {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:40:31.831847 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:31.840256 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-07ab85be-4a30-4ab0-abfd-d1f073a84758 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 200 len: 1330 microversion: 2.1 time: 0.105932 Jul 18 02:40:31.840838 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 371/744] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:31 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:32.140968 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-41d7568a-b876-49d8-95bc-df685915f27a req-896d6c4a-2ae1-4e8a-87a5-2918ec132074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2211074-6d69-4b22-b254-ea00a4ecc4c6", "name": "network-vif-plugged", "status": "completed", "tag": "88e1f36a-f13d-4fe9-af74-bfa7d331b96a"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:32.147032 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=6 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:32.150776 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-41d7568a-b876-49d8-95bc-df685915f27a req-896d6c4a-2ae1-4e8a-87a5-2918ec132074 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:32.151244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-41d7568a-b876-49d8-95bc-df685915f27a req-896d6c4a-2ae1-4e8a-87a5-2918ec132074 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:32.154959 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:32.163034 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-41d7568a-b876-49d8-95bc-df685915f27a req-896d6c4a-2ae1-4e8a-87a5-2918ec132074 service nova] Creating event network-vif-plugged:88e1f36a-f13d-4fe9-af74-bfa7d331b96a for instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 on hv-cinder-85001 Jul 18 02:40:32.167889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-41d7568a-b876-49d8-95bc-df685915f27a req-896d6c4a-2ae1-4e8a-87a5-2918ec132074 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030606 Jul 18 02:40:32.168629 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 374/745] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:32.279095 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f2223345-5c94-416c-856e-970d38209802 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:32.279797 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f2223345-5c94-416c-856e-970d38209802 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:32.286791 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2223345-5c94-416c-856e-970d38209802 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:32.287368 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2223345-5c94-416c-856e-970d38209802 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:32.288208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2223345-5c94-416c-856e-970d38209802 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:32.288732 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2223345-5c94-416c-856e-970d38209802 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:32.417924 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f2223345-5c94-416c-856e-970d38209802 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:32.426020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f2223345-5c94-416c-856e-970d38209802 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1363 microversion: 2.1 time: 0.150748 Jul 18 02:40:32.426634 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 372/746] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:32 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:32.859235 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8f73a663-05df-4cc4-8bd5-271ce7ed1d4f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:32.859892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8f73a663-05df-4cc4-8bd5-271ce7ed1d4f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:32.867542 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f73a663-05df-4cc4-8bd5-271ce7ed1d4f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:32.867998 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f73a663-05df-4cc4-8bd5-271ce7ed1d4f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:32.868762 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f73a663-05df-4cc4-8bd5-271ce7ed1d4f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:32.869310 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f73a663-05df-4cc4-8bd5-271ce7ed1d4f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:32.882894 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-8f73a663-05df-4cc4-8bd5-271ce7ed1d4f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8f73a663-05df-4cc4-8bd5-271ce7ed1d4f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc HTTP/1.1 Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:40:32.884496 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:40:32.886048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '5530cea9-7344-405e-bf59-9d4f629dddbc'} Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:40:32.886987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:40:32.888411 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:40:32.889762 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8f73a663-05df-4cc4-8bd5-271ce7ed1d4f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:40:32.889762 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8f73a663-05df-4cc4-8bd5-271ce7ed1d4f tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 404 len: 111 microversion: 2.1 time: 0.031373 Jul 18 02:40:32.889762 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 375/747] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:32 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:40:32.894647 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-33dfe04e-d868-4585-acb3-414a31659bca tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '.version_select at 0x7f28ee593430>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:33.049865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-33dfe04e-d868-4585-acb3-414a31659bca tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-519827577" status: 202 len: 0 microversion: 2.1 time: 0.158867 Jul 18 02:40:33.050503 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 373/748] 10.222.0.66 () {58 vars in 1217 bytes} [Mon Jul 18 02:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-519827577 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:40:33.443781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-00229723-16df-40a8-abaf-92a288871b01 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:33.444391 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-00229723-16df-40a8-abaf-92a288871b01 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:33.451304 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00229723-16df-40a8-abaf-92a288871b01 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:33.451756 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00229723-16df-40a8-abaf-92a288871b01 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:33.452573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00229723-16df-40a8-abaf-92a288871b01 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:33.453008 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-00229723-16df-40a8-abaf-92a288871b01 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:33.663330 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-00229723-16df-40a8-abaf-92a288871b01 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:33.670847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-00229723-16df-40a8-abaf-92a288871b01 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1363 microversion: 2.1 time: 0.231326 Jul 18 02:40:33.671418 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 376/749] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:33 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:33.859372 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8bd7c7a3-c632-4daa-ab93-1d375d2f9e53 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: .version_select at 0x7f28ee508f70>, body: {"keypair": {"name": "tempest-keypair-1979378916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZGZrFvomqbvOfpE9Ydwtgb2bpyHCLoplfRtgyqh7FE2E5S82eGWl0E8TYIiSqBEaMjB6un4ej/71PAqA8yi0tXLNy6WQm1q0fGXKNRqEJ33jYUC609Elh5tWSNS9w+VA=="}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:33.873689 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-8bd7c7a3-c632-4daa-ab93-1d375d2f9e53 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'key_pairs'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:33.877504 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-8bd7c7a3-c632-4daa-ab93-1d375d2f9e53 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for user 94c16391d39f4498a55c89bf2838788f and project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'key_pairs'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:33.977057 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8bd7c7a3-c632-4daa-ab93-1d375d2f9e53 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118570 Jul 18 02:40:33.977057 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 374/750] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 18 02:40:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:34.110255 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-34d536e6-0d20-47db-9f07-e355bf6007bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:34.110850 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-34d536e6-0d20-47db-9f07-e355bf6007bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:34.117757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34d536e6-0d20-47db-9f07-e355bf6007bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:34.118228 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34d536e6-0d20-47db-9f07-e355bf6007bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:34.118989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34d536e6-0d20-47db-9f07-e355bf6007bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:34.119459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-34d536e6-0d20-47db-9f07-e355bf6007bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:34.199275 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-34d536e6-0d20-47db-9f07-e355bf6007bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lazy-loading 'services' on Instance uuid 202ad2e8-7648-4965-afb6-736cb94b74ac {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:40:34.448337 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-34d536e6-0d20-47db-9f07-e355bf6007bd tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "DELETE /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments/d65dbf55-24f0-4fa1-95f8-768138d5c0f4" status: 202 len: 0 microversion: 2.1 time: 0.342092 Jul 18 02:40:34.448958 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 377/751] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:40:34 2022] DELETE /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments/d65dbf55-24f0-4fa1-95f8-768138d5c0f4 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:40:34.457295 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fd835e02-378f-4de8-8f30-fee09fde4ea0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:34.458370 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fd835e02-378f-4de8-8f30-fee09fde4ea0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:34.464572 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fd835e02-378f-4de8-8f30-fee09fde4ea0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:34.465252 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fd835e02-378f-4de8-8f30-fee09fde4ea0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:34.466023 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fd835e02-378f-4de8-8f30-fee09fde4ea0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:34.466500 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fd835e02-378f-4de8-8f30-fee09fde4ea0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:34.499659 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fd835e02-378f-4de8-8f30-fee09fde4ea0 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046324 Jul 18 02:40:34.501235 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 375/752] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:40:34 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:34.689705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2049490a-4e3f-4f4c-bf5f-2eae7a38f276 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:34.690478 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2049490a-4e3f-4f4c-bf5f-2eae7a38f276 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:34.696920 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2049490a-4e3f-4f4c-bf5f-2eae7a38f276 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:34.697395 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2049490a-4e3f-4f4c-bf5f-2eae7a38f276 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:34.698675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2049490a-4e3f-4f4c-bf5f-2eae7a38f276 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:34.703660 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2049490a-4e3f-4f4c-bf5f-2eae7a38f276 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:34.840228 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2049490a-4e3f-4f4c-bf5f-2eae7a38f276 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:34.847918 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2049490a-4e3f-4f4c-bf5f-2eae7a38f276 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1363 microversion: 2.1 time: 0.162919 Jul 18 02:40:34.848497 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 378/753] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:34 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:35.512335 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-dfce2af2-41f8-41d3-be89-4d46a21edeaa tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:35.513319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-dfce2af2-41f8-41d3-be89-4d46a21edeaa tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:35.519750 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dfce2af2-41f8-41d3-be89-4d46a21edeaa tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:35.520203 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dfce2af2-41f8-41d3-be89-4d46a21edeaa tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:35.521109 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dfce2af2-41f8-41d3-be89-4d46a21edeaa tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:35.521701 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dfce2af2-41f8-41d3-be89-4d46a21edeaa tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:35.550905 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-dfce2af2-41f8-41d3-be89-4d46a21edeaa tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 Jul 18 02:40:35.551422 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 376/754] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:40:35 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:35.865736 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a3ab1700-6ebf-4dca-9159-01e7aa2e78f3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:35.866425 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a3ab1700-6ebf-4dca-9159-01e7aa2e78f3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:35.873005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3ab1700-6ebf-4dca-9159-01e7aa2e78f3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:35.873483 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3ab1700-6ebf-4dca-9159-01e7aa2e78f3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:35.874516 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3ab1700-6ebf-4dca-9159-01e7aa2e78f3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:35.874962 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3ab1700-6ebf-4dca-9159-01e7aa2e78f3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:36.080218 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a3ab1700-6ebf-4dca-9159-01e7aa2e78f3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:36.088263 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a3ab1700-6ebf-4dca-9159-01e7aa2e78f3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1548 microversion: 2.1 time: 0.227413 Jul 18 02:40:36.088839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 379/755] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:35 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1548 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:36.104950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-dc4d3150-53da-47f8-af28-4256472fe1e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:36.105496 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-dc4d3150-53da-47f8-af28-4256472fe1e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:36.111425 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc4d3150-53da-47f8-af28-4256472fe1e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:36.118326 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc4d3150-53da-47f8-af28-4256472fe1e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:36.118326 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc4d3150-53da-47f8-af28-4256472fe1e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:36.118326 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dc4d3150-53da-47f8-af28-4256472fe1e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:36.189176 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-dc4d3150-53da-47f8-af28-4256472fe1e0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088038 Jul 18 02:40:36.189812 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 377/756] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 18 02:40:36 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:36.534631 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1988555174", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdc6ffcf-95a1-4f66-b96c-1c077c87b2a3"}], "security_groups": [{"name": "tempest-securitygroup--265073160"}], "key_name": "tempest-keypair-1979378916", "user_data": "}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:36.563391 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8ab54832-d325-4d9a-a125-851bccc61d3c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:36.564520 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8ab54832-d325-4d9a-a125-851bccc61d3c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:36.571325 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ab54832-d325-4d9a-a125-851bccc61d3c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:36.571777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ab54832-d325-4d9a-a125-851bccc61d3c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:36.572554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ab54832-d325-4d9a-a125-851bccc61d3c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:36.573365 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ab54832-d325-4d9a-a125-851bccc61d3c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:36.617120 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8ab54832-d325-4d9a-a125-851bccc61d3c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057395 Jul 18 02:40:36.617885 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 378/757] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:40:36 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:40:36.659249 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.network.neutron [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] validate_networks() for [('cdc6ffcf-95a1-4f66-b96c-1c077c87b2a3', None, None, None, None, None)] {{(pid=124890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:40:36.701661 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fcb6af86-e7d1-4359-b868-9789775ed832 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:36.702192 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fcb6af86-e7d1-4359-b868-9789775ed832 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:36.708569 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fcb6af86-e7d1-4359-b868-9789775ed832 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:36.708748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fcb6af86-e7d1-4359-b868-9789775ed832 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:36.709617 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fcb6af86-e7d1-4359-b868-9789775ed832 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:36.710056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fcb6af86-e7d1-4359-b868-9789775ed832 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:36.735375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fcb6af86-e7d1-4359-b868-9789775ed832 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:40:37.066859 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fcb6af86-e7d1-4359-b868-9789775ed832 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "DELETE /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 204 len: 0 microversion: 2.1 time: 0.368954 Jul 18 02:40:37.067692 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 379/758] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:40:36 2022] DELETE /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:40:37.077003 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fae9b6a6-6dc4-4661-a2c7-b481d1278098 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:37.077975 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fae9b6a6-6dc4-4661-a2c7-b481d1278098 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:37.085901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fae9b6a6-6dc4-4661-a2c7-b481d1278098 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:37.085901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fae9b6a6-6dc4-4661-a2c7-b481d1278098 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:37.086979 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fae9b6a6-6dc4-4661-a2c7-b481d1278098 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:37.087421 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fae9b6a6-6dc4-4661-a2c7-b481d1278098 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:37.105210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Flavor limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:40:37.105767 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Image limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:40:37.106353 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Flavor pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:40:37.107030 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Image pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:40:37.107650 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:40:37.119824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:37.120914 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:37.121720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:37.123478 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:37.140017 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:40:37.144300 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Getting quotas for user 94c16391d39f4498a55c89bf2838788f and project 4b02a417904a474abcab1eec5cea9c7e. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:40:37.156257 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Going to run 1 instances... {{(pid=124890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:40:37.158571 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:40:37.286956 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-62fadb79-6546-4b95-8ed2-ad831e3d265d tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.756523 Jul 18 02:40:37.287892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 380/759] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:40:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:40:37.297718 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7576e83a-e339-421d-94e3-c005e245bcad tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:37.298434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7576e83a-e339-421d-94e3-c005e245bcad tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:37.366339 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7576e83a-e339-421d-94e3-c005e245bcad tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:37.374442 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7576e83a-e339-421d-94e3-c005e245bcad tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1242 microversion: 2.1 time: 0.080661 Jul 18 02:40:37.375015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 381/760] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:37 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:37.427126 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fae9b6a6-6dc4-4661-a2c7-b481d1278098 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:37.435277 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fae9b6a6-6dc4-4661-a2c7-b481d1278098 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1688 microversion: 2.1 time: 0.362871 Jul 18 02:40:37.435974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 380/761] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:37 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1688 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:37.585528 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-d44a7377-15d3-4d4b-bf76-d2173e39f203 req-566e82a4-e0c3-4569-9ac0-4b1d000cd1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2211074-6d69-4b22-b254-ea00a4ecc4c6", "tag": "88e1f36a-f13d-4fe9-af74-bfa7d331b96a"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:37.594058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-d44a7377-15d3-4d4b-bf76-d2173e39f203 req-566e82a4-e0c3-4569-9ac0-4b1d000cd1d5 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:37.594651 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-d44a7377-15d3-4d4b-bf76-d2173e39f203 req-566e82a4-e0c3-4569-9ac0-4b1d000cd1d5 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:37.606450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-d44a7377-15d3-4d4b-bf76-d2173e39f203 req-566e82a4-e0c3-4569-9ac0-4b1d000cd1d5 service nova] Creating event network-changed:88e1f36a-f13d-4fe9-af74-bfa7d331b96a for instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 on hv-cinder-85001 Jul 18 02:40:37.611514 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-d44a7377-15d3-4d4b-bf76-d2173e39f203 req-566e82a4-e0c3-4569-9ac0-4b1d000cd1d5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030317 Jul 18 02:40:37.612415 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 382/762] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:38.392172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fb4bc3b0-8b96-4c37-8843-b01b0a6f5e04 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:38.392908 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fb4bc3b0-8b96-4c37-8843-b01b0a6f5e04 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:38.400073 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fb4bc3b0-8b96-4c37-8843-b01b0a6f5e04 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:38.400530 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fb4bc3b0-8b96-4c37-8843-b01b0a6f5e04 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:38.401328 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fb4bc3b0-8b96-4c37-8843-b01b0a6f5e04 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:38.401770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fb4bc3b0-8b96-4c37-8843-b01b0a6f5e04 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:38.453892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-047be4bd-2106-457e-895f-32d6168e8271 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:38.455247 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-047be4bd-2106-457e-895f-32d6168e8271 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:38.462651 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-047be4bd-2106-457e-895f-32d6168e8271 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:38.463211 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-047be4bd-2106-457e-895f-32d6168e8271 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:38.464977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-047be4bd-2106-457e-895f-32d6168e8271 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:38.465640 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-047be4bd-2106-457e-895f-32d6168e8271 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:38.468108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fb4bc3b0-8b96-4c37-8843-b01b0a6f5e04 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:38.475913 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fb4bc3b0-8b96-4c37-8843-b01b0a6f5e04 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1246 microversion: 2.1 time: 0.087593 Jul 18 02:40:38.476493 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 381/763] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:38 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:38.600781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-047be4bd-2106-457e-895f-32d6168e8271 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:38.608588 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-047be4bd-2106-457e-895f-32d6168e8271 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1688 microversion: 2.1 time: 0.159431 Jul 18 02:40:38.614461 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 383/764] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:38 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:39.493654 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-aa18c3a8-8fd4-4f10-9cfe-e6697cf67d13 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:39.494294 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-aa18c3a8-8fd4-4f10-9cfe-e6697cf67d13 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:39.500761 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-aa18c3a8-8fd4-4f10-9cfe-e6697cf67d13 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:39.501275 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-aa18c3a8-8fd4-4f10-9cfe-e6697cf67d13 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:39.502238 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-aa18c3a8-8fd4-4f10-9cfe-e6697cf67d13 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:39.502551 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-aa18c3a8-8fd4-4f10-9cfe-e6697cf67d13 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:39.567713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-aa18c3a8-8fd4-4f10-9cfe-e6697cf67d13 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:39.577606 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-aa18c3a8-8fd4-4f10-9cfe-e6697cf67d13 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1246 microversion: 2.1 time: 0.088739 Jul 18 02:40:39.578634 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 382/765] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:39 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:39.626405 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9bdacc78-567d-47f6-8bc2-21f4e4ac083d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:39.627173 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9bdacc78-567d-47f6-8bc2-21f4e4ac083d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:39.633909 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bdacc78-567d-47f6-8bc2-21f4e4ac083d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:39.634438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bdacc78-567d-47f6-8bc2-21f4e4ac083d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:39.635787 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bdacc78-567d-47f6-8bc2-21f4e4ac083d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:39.635787 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bdacc78-567d-47f6-8bc2-21f4e4ac083d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:39.766919 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9bdacc78-567d-47f6-8bc2-21f4e4ac083d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:39.775207 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9bdacc78-567d-47f6-8bc2-21f4e4ac083d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1688 microversion: 2.1 time: 0.152759 Jul 18 02:40:39.777120 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 384/766] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:39 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:40.597085 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4aee8aae-026a-4a78-a528-1ae5cd1aa580 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:40.597722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4aee8aae-026a-4a78-a528-1ae5cd1aa580 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:40.604454 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4aee8aae-026a-4a78-a528-1ae5cd1aa580 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:40.604894 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4aee8aae-026a-4a78-a528-1ae5cd1aa580 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:40.605665 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4aee8aae-026a-4a78-a528-1ae5cd1aa580 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:40.606110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4aee8aae-026a-4a78-a528-1ae5cd1aa580 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:40.673182 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4aee8aae-026a-4a78-a528-1ae5cd1aa580 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:40.681837 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4aee8aae-026a-4a78-a528-1ae5cd1aa580 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1246 microversion: 2.1 time: 0.088597 Jul 18 02:40:40.682688 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 383/767] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:40 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:40.792643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9bc58187-4c6a-4361-a6cf-d70cbde116f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:40.793720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9bc58187-4c6a-4361-a6cf-d70cbde116f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:40.800205 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bc58187-4c6a-4361-a6cf-d70cbde116f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:40.800660 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bc58187-4c6a-4361-a6cf-d70cbde116f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:40.801424 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bc58187-4c6a-4361-a6cf-d70cbde116f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:40.801863 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9bc58187-4c6a-4361-a6cf-d70cbde116f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:40.932504 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9bc58187-4c6a-4361-a6cf-d70cbde116f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:40.941810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9bc58187-4c6a-4361-a6cf-d70cbde116f2 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1688 microversion: 2.1 time: 0.152877 Jul 18 02:40:40.942717 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 385/768] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:40 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:41.699039 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d25123a7-57a1-469f-a140-0ca510b9654a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:41.699647 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d25123a7-57a1-469f-a140-0ca510b9654a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:41.706284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d25123a7-57a1-469f-a140-0ca510b9654a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:41.706892 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d25123a7-57a1-469f-a140-0ca510b9654a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:41.707511 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d25123a7-57a1-469f-a140-0ca510b9654a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:41.708548 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d25123a7-57a1-469f-a140-0ca510b9654a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:41.781701 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d25123a7-57a1-469f-a140-0ca510b9654a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:41.789965 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d25123a7-57a1-469f-a140-0ca510b9654a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1294 microversion: 2.1 time: 0.094725 Jul 18 02:40:41.790626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 384/769] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:41 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:41.958696 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f7ca7376-b590-478a-8872-8ea2a18d10f4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:41.959310 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f7ca7376-b590-478a-8872-8ea2a18d10f4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:41.965734 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f7ca7376-b590-478a-8872-8ea2a18d10f4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:41.966212 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f7ca7376-b590-478a-8872-8ea2a18d10f4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:41.966975 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f7ca7376-b590-478a-8872-8ea2a18d10f4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:41.967405 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f7ca7376-b590-478a-8872-8ea2a18d10f4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:42.043559 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f7ca7376-b590-478a-8872-8ea2a18d10f4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:42.071130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f7ca7376-b590-478a-8872-8ea2a18d10f4 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1620 microversion: 2.1 time: 0.116215 Jul 18 02:40:42.083374 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 386/770] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:41 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1620 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:42.179927 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-b6bed43f-d5ec-4bcc-8aca-c39174a6dc7e req-c2d09611-3ee3-4386-9192-b2e84b7415a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202ad2e8-7648-4965-afb6-736cb94b74ac", "name": "network-vif-deleted", "tag": "b201d32b-4faf-4b5d-b867-467d2b9bcc9a"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:42.190983 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-b6bed43f-d5ec-4bcc-8aca-c39174a6dc7e req-c2d09611-3ee3-4386-9192-b2e84b7415a8 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:42.191676 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-b6bed43f-d5ec-4bcc-8aca-c39174a6dc7e req-c2d09611-3ee3-4386-9192-b2e84b7415a8 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:42.219588 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-b6bed43f-d5ec-4bcc-8aca-c39174a6dc7e req-c2d09611-3ee3-4386-9192-b2e84b7415a8 service nova] Creating event network-vif-deleted:b201d32b-4faf-4b5d-b867-467d2b9bcc9a for instance 202ad2e8-7648-4965-afb6-736cb94b74ac on hv-cinder-85001 Jul 18 02:40:42.226305 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-b6bed43f-d5ec-4bcc-8aca-c39174a6dc7e req-c2d09611-3ee3-4386-9192-b2e84b7415a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165679 Jul 18 02:40:42.227277 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 385/771] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:42.808002 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7af3076d-571f-43df-87b8-40d3f84ede76 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:42.809988 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7af3076d-571f-43df-87b8-40d3f84ede76 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:42.810626 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:42.815268 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7af3076d-571f-43df-87b8-40d3f84ede76 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:42.815768 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7af3076d-571f-43df-87b8-40d3f84ede76 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:42.816476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7af3076d-571f-43df-87b8-40d3f84ede76 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:42.816913 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7af3076d-571f-43df-87b8-40d3f84ede76 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:42.980847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7af3076d-571f-43df-87b8-40d3f84ede76 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:43.009315 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7af3076d-571f-43df-87b8-40d3f84ede76 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1367 microversion: 2.1 time: 0.186687 Jul 18 02:40:43.010066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 387/772] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:42 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:43.089925 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:43.091231 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:43.100004 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:43.100907 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:43.101874 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:43.102333 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:43.146312 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:43.146774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:43.147228 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lazy-loading 'fault' on Instance uuid 202ad2e8-7648-4965-afb6-736cb94b74ac {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:40:43.203758 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:43.212694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-184f6826-94d4-46de-a9f9-6bd53fee98fb tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 200 len: 1334 microversion: 2.1 time: 0.127372 Jul 18 02:40:43.213445 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 386/773] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:43 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 1334 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:44.027947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-81e6c60b-67cf-40a6-bb8f-30dd54556229 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:44.028544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-81e6c60b-67cf-40a6-bb8f-30dd54556229 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:44.036651 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-81e6c60b-67cf-40a6-bb8f-30dd54556229 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:44.037347 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-81e6c60b-67cf-40a6-bb8f-30dd54556229 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:44.038151 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-81e6c60b-67cf-40a6-bb8f-30dd54556229 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:44.038593 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-81e6c60b-67cf-40a6-bb8f-30dd54556229 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:44.176768 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-81e6c60b-67cf-40a6-bb8f-30dd54556229 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:44.184529 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-81e6c60b-67cf-40a6-bb8f-30dd54556229 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1367 microversion: 2.1 time: 0.160501 Jul 18 02:40:44.185097 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 388/774] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:44 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:44.230693 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-da3ac1ea-fcc6-448e-8006-8f6cf43f7017 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:44.231515 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-da3ac1ea-fcc6-448e-8006-8f6cf43f7017 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 202ad2e8-7648-4965-afb6-736cb94b74ac] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:44.233656 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=4 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:44.239417 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da3ac1ea-fcc6-448e-8006-8f6cf43f7017 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:44.240147 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da3ac1ea-fcc6-448e-8006-8f6cf43f7017 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:44.240982 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da3ac1ea-fcc6-448e-8006-8f6cf43f7017 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:44.241801 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-da3ac1ea-fcc6-448e-8006-8f6cf43f7017 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:44.244776 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-2a2206b5-f649-4873-be1b-97ebfa7bdc7c req-5ebba756-6e08-4490-8519-9a54a48b3498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85324481-a04a-4d16-b72d-6a355b0775d0", "tag": "09ed14d6-d57e-45f3-ae2a-c4a16c9aba4d"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:44.245992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:44.253931 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-2a2206b5-f649-4873-be1b-97ebfa7bdc7c req-5ebba756-6e08-4490-8519-9a54a48b3498 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:44.254974 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-2a2206b5-f649-4873-be1b-97ebfa7bdc7c req-5ebba756-6e08-4490-8519-9a54a48b3498 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:44.257284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-da3ac1ea-fcc6-448e-8006-8f6cf43f7017 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] HTTP exception thrown: Instance 202ad2e8-7648-4965-afb6-736cb94b74ac could not be found. Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-da3ac1ea-fcc6-448e-8006-8f6cf43f7017 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Request method failure captured: Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac HTTP/1.1 Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1McuPtx3mXnBtnAQz6hcyUDMQQKVKo-T7dvPGtmZuTuHw7GzvsTn0I34zu4yEdIofz-yDNRRgXDEBOkIkJBrQ94epik1LKFvkwOHcowjlukXqP9m0auyRN8lNxgEcAPqwnRsqanPw5IYVJ7_ivL4Sbf9V6H62dfIQ2mbExpaWFvVh-Y Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 9ec4c1c1687944b98c1c5cefe05df095 Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:40:44.259124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9ec4c1c1687944b98c1c5cefe05df095", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 9ec4c1c1687944b98c1c5cefe05df095 Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-ServerRescueNegativeTestJSON-988773994-project Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: d281c92e20d04004a679a8ec65f9e6d5 Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-ServerRescueNegativeTestJSON-988773994-project Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 202ad2e8-7648-4965-afb6-736cb94b74ac could not be found. Jul 18 02:40:44.260773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '202ad2e8-7648-4965-afb6-736cb94b74ac'} Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 202ad2e8-7648-4965-afb6-736cb94b74ac could not be found. Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:40:44.261809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 202ad2e8-7648-4965-afb6-736cb94b74ac could not be found. Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 202ad2e8-7648-4965-afb6-736cb94b74ac could not be found. Jul 18 02:40:44.263349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:40:44.264661 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-da3ac1ea-fcc6-448e-8006-8f6cf43f7017 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Returning 404 to user: Instance 202ad2e8-7648-4965-afb6-736cb94b74ac could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:40:44.265053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-da3ac1ea-fcc6-448e-8006-8f6cf43f7017 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac" status: 404 len: 111 microversion: 2.1 time: 0.037488 Jul 18 02:40:44.265872 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 387/775] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:44 2022] GET /compute/v2.1/servers/202ad2e8-7648-4965-afb6-736cb94b74ac => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:40:44.268603 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-2a2206b5-f649-4873-be1b-97ebfa7bdc7c req-5ebba756-6e08-4490-8519-9a54a48b3498 service nova] Creating event network-changed:09ed14d6-d57e-45f3-ae2a-c4a16c9aba4d for instance 85324481-a04a-4d16-b72d-6a355b0775d0 on hv-cinder-85001 Jul 18 02:40:44.274214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c03d661b-0e2a-41ac-b472-9d6098c75926 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '.version_select at 0x7f28ee593c10>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:44.274664 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-2a2206b5-f649-4873-be1b-97ebfa7bdc7c req-5ebba756-6e08-4490-8519-9a54a48b3498 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033641 Jul 18 02:40:44.275174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 389/776] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:44.359123 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c03d661b-0e2a-41ac-b472-9d6098c75926 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-788002199" status: 202 len: 0 microversion: 2.1 time: 0.089117 Jul 18 02:40:44.359713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 388/777] 10.222.0.66 () {58 vars in 1217 bytes} [Mon Jul 18 02:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-788002199 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:40:45.201329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e5cee37d-9ce4-496e-aeb9-75013d5e6e08 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:45.203404 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e5cee37d-9ce4-496e-aeb9-75013d5e6e08 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:45.209354 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e5cee37d-9ce4-496e-aeb9-75013d5e6e08 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:45.209802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e5cee37d-9ce4-496e-aeb9-75013d5e6e08 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:45.210712 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e5cee37d-9ce4-496e-aeb9-75013d5e6e08 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:45.211150 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e5cee37d-9ce4-496e-aeb9-75013d5e6e08 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:45.341429 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e5cee37d-9ce4-496e-aeb9-75013d5e6e08 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:45.351328 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e5cee37d-9ce4-496e-aeb9-75013d5e6e08 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1367 microversion: 2.1 time: 0.154196 Jul 18 02:40:45.351994 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 390/778] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:45 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:46.370406 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4f16ad8b-50d9-4dff-8a9f-b40c4999aa75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:46.371010 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4f16ad8b-50d9-4dff-8a9f-b40c4999aa75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:46.377346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4f16ad8b-50d9-4dff-8a9f-b40c4999aa75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:46.377872 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4f16ad8b-50d9-4dff-8a9f-b40c4999aa75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:46.378585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4f16ad8b-50d9-4dff-8a9f-b40c4999aa75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:46.387757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4f16ad8b-50d9-4dff-8a9f-b40c4999aa75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:46.508419 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4f16ad8b-50d9-4dff-8a9f-b40c4999aa75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:46.516053 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4f16ad8b-50d9-4dff-8a9f-b40c4999aa75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1367 microversion: 2.1 time: 0.151114 Jul 18 02:40:46.516616 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 389/779] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:46 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:47.532638 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9ac70655-d912-4625-b5f9-fc72a159fc00 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:47.533344 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9ac70655-d912-4625-b5f9-fc72a159fc00 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:47.535801 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:47.536497 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=8 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:47.541628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9ac70655-d912-4625-b5f9-fc72a159fc00 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:47.543538 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9ac70655-d912-4625-b5f9-fc72a159fc00 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:47.543538 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9ac70655-d912-4625-b5f9-fc72a159fc00 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:47.543538 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9ac70655-d912-4625-b5f9-fc72a159fc00 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:47.672788 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9ac70655-d912-4625-b5f9-fc72a159fc00 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:47.680172 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9ac70655-d912-4625-b5f9-fc72a159fc00 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1367 microversion: 2.1 time: 0.151409 Jul 18 02:40:47.680745 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 391/780] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:47 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:47.799190 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0c1fee1e-00e8-4bcf-96d9-464557ba5296 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:47.799692 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0c1fee1e-00e8-4bcf-96d9-464557ba5296 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:47.807092 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c1fee1e-00e8-4bcf-96d9-464557ba5296 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:47.807548 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c1fee1e-00e8-4bcf-96d9-464557ba5296 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:47.808324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c1fee1e-00e8-4bcf-96d9-464557ba5296 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:47.808767 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0c1fee1e-00e8-4bcf-96d9-464557ba5296 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:47.834608 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0c1fee1e-00e8-4bcf-96d9-464557ba5296 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:40:48.163972 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0c1fee1e-00e8-4bcf-96d9-464557ba5296 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "DELETE /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 204 len: 0 microversion: 2.1 time: 0.368306 Jul 18 02:40:48.164552 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 390/781] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:40:47 2022] DELETE /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:40:48.172608 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e217de7f-e447-48a1-bb5c-b8211bd81591 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:48.173261 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e217de7f-e447-48a1-bb5c-b8211bd81591 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:48.179802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e217de7f-e447-48a1-bb5c-b8211bd81591 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:48.180259 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e217de7f-e447-48a1-bb5c-b8211bd81591 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:48.181362 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e217de7f-e447-48a1-bb5c-b8211bd81591 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:48.181804 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e217de7f-e447-48a1-bb5c-b8211bd81591 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:48.315554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e217de7f-e447-48a1-bb5c-b8211bd81591 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:48.323423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e217de7f-e447-48a1-bb5c-b8211bd81591 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1506 microversion: 2.1 time: 0.154658 Jul 18 02:40:48.324010 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 392/782] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:48 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:48.697863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-32aaf253-d16a-4b0c-acc1-e6f75044ac5a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:48.702826 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-32aaf253-d16a-4b0c-acc1-e6f75044ac5a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:48.704604 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32aaf253-d16a-4b0c-acc1-e6f75044ac5a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:48.705052 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32aaf253-d16a-4b0c-acc1-e6f75044ac5a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:48.705798 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32aaf253-d16a-4b0c-acc1-e6f75044ac5a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:48.706264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32aaf253-d16a-4b0c-acc1-e6f75044ac5a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:48.835171 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-32aaf253-d16a-4b0c-acc1-e6f75044ac5a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:48.842503 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-32aaf253-d16a-4b0c-acc1-e6f75044ac5a tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1367 microversion: 2.1 time: 0.149486 Jul 18 02:40:48.843070 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 391/783] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:48 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:49.340795 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a4129539-9b12-4b26-9f98-f83ec18c5d90 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:49.341413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a4129539-9b12-4b26-9f98-f83ec18c5d90 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:49.348046 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4129539-9b12-4b26-9f98-f83ec18c5d90 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:49.348500 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4129539-9b12-4b26-9f98-f83ec18c5d90 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:49.349313 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4129539-9b12-4b26-9f98-f83ec18c5d90 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:49.349788 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a4129539-9b12-4b26-9f98-f83ec18c5d90 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:49.480621 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a4129539-9b12-4b26-9f98-f83ec18c5d90 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:49.488205 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a4129539-9b12-4b26-9f98-f83ec18c5d90 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1506 microversion: 2.1 time: 0.151420 Jul 18 02:40:49.488776 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 393/784] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:49 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:49.859045 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-576c1ed9-df5b-4ee7-82f3-3403c07856a0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:49.859653 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-576c1ed9-df5b-4ee7-82f3-3403c07856a0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:49.867058 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-576c1ed9-df5b-4ee7-82f3-3403c07856a0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:49.867456 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-576c1ed9-df5b-4ee7-82f3-3403c07856a0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:49.868256 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-576c1ed9-df5b-4ee7-82f3-3403c07856a0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:49.868694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-576c1ed9-df5b-4ee7-82f3-3403c07856a0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:50.063462 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-4c92ad57-99dd-4e66-911e-b2dafa3d894c req-d49e799d-bd07-4d99-9af2-0c9305983c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85324481-a04a-4d16-b72d-6a355b0775d0", "name": "network-vif-plugged", "status": "completed", "tag": "09ed14d6-d57e-45f3-ae2a-c4a16c9aba4d"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:50.072021 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-4c92ad57-99dd-4e66-911e-b2dafa3d894c req-d49e799d-bd07-4d99-9af2-0c9305983c97 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:50.072602 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-4c92ad57-99dd-4e66-911e-b2dafa3d894c req-d49e799d-bd07-4d99-9af2-0c9305983c97 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:50.084652 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-4c92ad57-99dd-4e66-911e-b2dafa3d894c req-d49e799d-bd07-4d99-9af2-0c9305983c97 service nova] Creating event network-vif-plugged:09ed14d6-d57e-45f3-ae2a-c4a16c9aba4d for instance 85324481-a04a-4d16-b72d-6a355b0775d0 on hv-cinder-85001 Jul 18 02:40:50.094418 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-4c92ad57-99dd-4e66-911e-b2dafa3d894c req-d49e799d-bd07-4d99-9af2-0c9305983c97 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093659 Jul 18 02:40:50.094418 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 394/785] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:40:50.267392 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-576c1ed9-df5b-4ee7-82f3-3403c07856a0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:50.275349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-576c1ed9-df5b-4ee7-82f3-3403c07856a0 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1367 microversion: 2.1 time: 0.420182 Jul 18 02:40:50.275917 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 392/786] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:49 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:50.507191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7c540ce4-dc25-458c-8622-125f9637fc2c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:50.507929 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7c540ce4-dc25-458c-8622-125f9637fc2c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:50.514318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7c540ce4-dc25-458c-8622-125f9637fc2c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:50.514773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7c540ce4-dc25-458c-8622-125f9637fc2c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:50.515607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7c540ce4-dc25-458c-8622-125f9637fc2c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:50.516068 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-7c540ce4-dc25-458c-8622-125f9637fc2c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:50.520241 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:50.651573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7c540ce4-dc25-458c-8622-125f9637fc2c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:50.658970 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7c540ce4-dc25-458c-8622-125f9637fc2c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1506 microversion: 2.1 time: 0.157791 Jul 18 02:40:50.659574 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 395/787] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:50 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:50.802942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0beac4a5-ca12-45a0-b967-9c2cd0090737 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:50.803440 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0beac4a5-ca12-45a0-b967-9c2cd0090737 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:50.809562 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0beac4a5-ca12-45a0-b967-9c2cd0090737 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:50.810002 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0beac4a5-ca12-45a0-b967-9c2cd0090737 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:50.810774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0beac4a5-ca12-45a0-b967-9c2cd0090737 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:50.811206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0beac4a5-ca12-45a0-b967-9c2cd0090737 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:50.835662 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0beac4a5-ca12-45a0-b967-9c2cd0090737 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/ips" status: 200 len: 152 microversion: 2.20 time: 0.088175 Jul 18 02:40:50.836405 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 393/788] 10.222.0.66 () {60 vars in 1288 bytes} [Mon Jul 18 02:40:50 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/ips => generated 152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 02:40:51.293045 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cc8e4536-c885-4898-bc4e-c3cf510984dc tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:51.293776 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cc8e4536-c885-4898-bc4e-c3cf510984dc tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:51.300931 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc8e4536-c885-4898-bc4e-c3cf510984dc tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:51.301388 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc8e4536-c885-4898-bc4e-c3cf510984dc tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:51.302879 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc8e4536-c885-4898-bc4e-c3cf510984dc tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:51.303486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc8e4536-c885-4898-bc4e-c3cf510984dc tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:51.459804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-ff438c25-8636-4ab3-ad42-c1cfaf3d6138 req-9774f656-d6c3-4512-a9d4-e3df3ed0eb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a73b2c-9286-4682-a1d3-a1893278cead", "name": "network-vif-deleted", "tag": "724ae0ef-7a5c-49c2-8a15-2a37d668dc73"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:51.465850 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:51.476381 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-ff438c25-8636-4ab3-ad42-c1cfaf3d6138 req-9774f656-d6c3-4512-a9d4-e3df3ed0eb3d service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:51.477236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-ff438c25-8636-4ab3-ad42-c1cfaf3d6138 req-9774f656-d6c3-4512-a9d4-e3df3ed0eb3d service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:51.483081 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cc8e4536-c885-4898-bc4e-c3cf510984dc tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:51.492187 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cc8e4536-c885-4898-bc4e-c3cf510984dc tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1367 microversion: 2.1 time: 0.203564 Jul 18 02:40:51.493830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 396/789] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:51 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:51.495002 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-ff438c25-8636-4ab3-ad42-c1cfaf3d6138 req-9774f656-d6c3-4512-a9d4-e3df3ed0eb3d service nova] Creating event network-vif-deleted:724ae0ef-7a5c-49c2-8a15-2a37d668dc73 for instance 64a73b2c-9286-4682-a1d3-a1893278cead on hv-cinder-85001 Jul 18 02:40:51.500190 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-ff438c25-8636-4ab3-ad42-c1cfaf3d6138 req-9774f656-d6c3-4512-a9d4-e3df3ed0eb3d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044343 Jul 18 02:40:51.501149 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 394/790] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:40:51.675682 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1d0d8f9e-5201-44cd-aa47-f2179da7d2df tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:51.676301 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1d0d8f9e-5201-44cd-aa47-f2179da7d2df tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:51.683788 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d0d8f9e-5201-44cd-aa47-f2179da7d2df tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:51.684228 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d0d8f9e-5201-44cd-aa47-f2179da7d2df tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:51.684982 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d0d8f9e-5201-44cd-aa47-f2179da7d2df tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:51.685410 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1d0d8f9e-5201-44cd-aa47-f2179da7d2df tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:51.748330 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1d0d8f9e-5201-44cd-aa47-f2179da7d2df tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:51.756880 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1d0d8f9e-5201-44cd-aa47-f2179da7d2df tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1464 microversion: 2.1 time: 0.084932 Jul 18 02:40:51.757474 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 397/791] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:51 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1464 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:52.511471 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b224bf29-01d3-4798-b1e9-918758b5b968 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:52.512171 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b224bf29-01d3-4798-b1e9-918758b5b968 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:52.518923 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b224bf29-01d3-4798-b1e9-918758b5b968 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:52.519374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b224bf29-01d3-4798-b1e9-918758b5b968 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:52.520139 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b224bf29-01d3-4798-b1e9-918758b5b968 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:52.520576 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b224bf29-01d3-4798-b1e9-918758b5b968 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:52.657269 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b224bf29-01d3-4798-b1e9-918758b5b968 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:52.665447 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b224bf29-01d3-4798-b1e9-918758b5b968 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1367 microversion: 2.1 time: 0.158941 Jul 18 02:40:52.666010 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 395/792] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:52 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:52.775579 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:52.776328 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:52.783169 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:52.783619 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:52.784392 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:52.784831 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:52.818630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:52.819084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:52.823071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lazy-loading 'fault' on Instance uuid 64a73b2c-9286-4682-a1d3-a1893278cead {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:40:52.862670 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:52.870821 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-24bbab1d-7f0e-46d7-a8a7-a44ab02615d3 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 200 len: 1311 microversion: 2.1 time: 0.100857 Jul 18 02:40:52.871395 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 398/793] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:52 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:53.000027 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ec9dacdd-86c2-4209-812b-e7fc9f629458 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:53.000480 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ec9dacdd-86c2-4209-812b-e7fc9f629458 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:53.006894 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec9dacdd-86c2-4209-812b-e7fc9f629458 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.007388 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec9dacdd-86c2-4209-812b-e7fc9f629458 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.008153 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec9dacdd-86c2-4209-812b-e7fc9f629458 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.008592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec9dacdd-86c2-4209-812b-e7fc9f629458 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.030911 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-ec9dacdd-86c2-4209-812b-e7fc9f629458 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lazy-loading 'flavor' on Instance uuid cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:40:53.598871 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ec9dacdd-86c2-4209-812b-e7fc9f629458 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "POST /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/action" status: 202 len: 0 microversion: 2.20 time: 0.603015 Jul 18 02:40:53.599672 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 396/794] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Jul 18 02:40:52 2022] POST /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:40:53.608346 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8e4c6035-17f5-4455-835f-8c1b6e080c26 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:53.618335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8e4c6035-17f5-4455-835f-8c1b6e080c26 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:53.618335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8e4c6035-17f5-4455-835f-8c1b6e080c26 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.618335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8e4c6035-17f5-4455-835f-8c1b6e080c26 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.618335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8e4c6035-17f5-4455-835f-8c1b6e080c26 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.619389 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8e4c6035-17f5-4455-835f-8c1b6e080c26 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.682907 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-27703961-a540-4627-aeb7-1b1eba020b9e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:53.683771 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-27703961-a540-4627-aeb7-1b1eba020b9e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:53.690317 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27703961-a540-4627-aeb7-1b1eba020b9e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.690773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27703961-a540-4627-aeb7-1b1eba020b9e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.691545 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27703961-a540-4627-aeb7-1b1eba020b9e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.691986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-27703961-a540-4627-aeb7-1b1eba020b9e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.752734 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8e4c6035-17f5-4455-835f-8c1b6e080c26 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:53.762131 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8e4c6035-17f5-4455-835f-8c1b6e080c26 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:53.763660 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8e4c6035-17f5-4455-835f-8c1b6e080c26 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:53.764834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8e4c6035-17f5-4455-835f-8c1b6e080c26 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.160418 Jul 18 02:40:53.765407 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 399/795] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:53 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:53.831780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-27703961-a540-4627-aeb7-1b1eba020b9e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:53.839337 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-27703961-a540-4627-aeb7-1b1eba020b9e tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1557 microversion: 2.1 time: 0.161064 Jul 18 02:40:53.839841 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 397/796] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:53 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:53.871102 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-995d878d-9b4d-4691-b2e8-b459d49a64a2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:53.871637 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-995d878d-9b4d-4691-b2e8-b459d49a64a2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:53.878416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-995d878d-9b4d-4691-b2e8-b459d49a64a2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.878948 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-995d878d-9b4d-4691-b2e8-b459d49a64a2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.879778 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-995d878d-9b4d-4691-b2e8-b459d49a64a2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.880281 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-995d878d-9b4d-4691-b2e8-b459d49a64a2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.893483 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4d7ad4c4-c10b-470b-98e9-5b69897640a1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:53.894877 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4d7ad4c4-c10b-470b-98e9-5b69897640a1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 64a73b2c-9286-4682-a1d3-a1893278cead] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:53.901597 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4d7ad4c4-c10b-470b-98e9-5b69897640a1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.909637 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4d7ad4c4-c10b-470b-98e9-5b69897640a1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.909637 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4d7ad4c4-c10b-470b-98e9-5b69897640a1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.909637 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4d7ad4c4-c10b-470b-98e9-5b69897640a1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.916614 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-4d7ad4c4-c10b-470b-98e9-5b69897640a1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] HTTP exception thrown: Instance 64a73b2c-9286-4682-a1d3-a1893278cead could not be found. Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4d7ad4c4-c10b-470b-98e9-5b69897640a1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Request method failure captured: Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead HTTP/1.1 Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1McuPtx3mXnBtnAQz6hcyUDMQQKVKo-T7dvPGtmZuTuHw7GzvsTn0I34zu4yEdIofz-yDNRRgXDEBOkIkJBrQ94epik1LKFvkwOHcowjlukXqP9m0auyRN8lNxgEcAPqwnRsqanPw5IYVJ7_ivL4Sbf9V6H62dfIQ2mbExpaWFvVh-Y Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 9ec4c1c1687944b98c1c5cefe05df095 Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:40:53.918290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9ec4c1c1687944b98c1c5cefe05df095", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 9ec4c1c1687944b98c1c5cefe05df095 Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-ServerRescueNegativeTestJSON-988773994-project Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: d281c92e20d04004a679a8ec65f9e6d5 Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-ServerRescueNegativeTestJSON-988773994-project Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 64a73b2c-9286-4682-a1d3-a1893278cead could not be found. Jul 18 02:40:53.919912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '64a73b2c-9286-4682-a1d3-a1893278cead'} Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a73b2c-9286-4682-a1d3-a1893278cead could not be found. Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:40:53.920790 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a73b2c-9286-4682-a1d3-a1893278cead could not be found. Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a73b2c-9286-4682-a1d3-a1893278cead could not be found. Jul 18 02:40:53.922280 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:40:53.923886 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4d7ad4c4-c10b-470b-98e9-5b69897640a1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Returning 404 to user: Instance 64a73b2c-9286-4682-a1d3-a1893278cead could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:40:53.923886 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4d7ad4c4-c10b-470b-98e9-5b69897640a1 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead" status: 404 len: 111 microversion: 2.1 time: 0.030398 Jul 18 02:40:53.923886 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 398/797] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:53 2022] GET /compute/v2.1/servers/64a73b2c-9286-4682-a1d3-a1893278cead => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:40:53.928713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a1576831-fdbe-42b6-815c-4d6e0e25dcfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:53.929210 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a1576831-fdbe-42b6-815c-4d6e0e25dcfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:53.935509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a1576831-fdbe-42b6-815c-4d6e0e25dcfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.935959 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a1576831-fdbe-42b6-815c-4d6e0e25dcfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.936738 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a1576831-fdbe-42b6-815c-4d6e0e25dcfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:53.937168 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a1576831-fdbe-42b6-815c-4d6e0e25dcfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:53.961391 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-995d878d-9b4d-4691-b2e8-b459d49a64a2 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094142 Jul 18 02:40:53.961995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 400/798] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Jul 18 02:40:53 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:53.962252 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a1576831-fdbe-42b6-815c-4d6e0e25dcfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:40:54.335878 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a1576831-fdbe-42b6-815c-4d6e0e25dcfe tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 204 len: 0 microversion: 2.1 time: 0.411060 Jul 18 02:40:54.336610 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 399/799] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:40:53 2022] DELETE /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:40:54.345110 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-745552db-2016-4c8d-970f-52eaead0c54d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:54.345720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-745552db-2016-4c8d-970f-52eaead0c54d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:54.352393 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-745552db-2016-4c8d-970f-52eaead0c54d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:54.355462 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-745552db-2016-4c8d-970f-52eaead0c54d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:54.355462 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-745552db-2016-4c8d-970f-52eaead0c54d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:54.355462 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-745552db-2016-4c8d-970f-52eaead0c54d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:54.618504 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-745552db-2016-4c8d-970f-52eaead0c54d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:54.625955 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-745552db-2016-4c8d-970f-52eaead0c54d tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.284907 Jul 18 02:40:54.626654 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 401/800] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:54 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:54.792372 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6b5cdccf-9adb-4da8-a658-bcd194d6f9d0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:54.793067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6b5cdccf-9adb-4da8-a658-bcd194d6f9d0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:54.799936 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6b5cdccf-9adb-4da8-a658-bcd194d6f9d0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:54.800392 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6b5cdccf-9adb-4da8-a658-bcd194d6f9d0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:54.801167 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6b5cdccf-9adb-4da8-a658-bcd194d6f9d0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:54.801606 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6b5cdccf-9adb-4da8-a658-bcd194d6f9d0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:54.938756 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6b5cdccf-9adb-4da8-a658-bcd194d6f9d0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:54.947843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6b5cdccf-9adb-4da8-a658-bcd194d6f9d0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:54.949551 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6b5cdccf-9adb-4da8-a658-bcd194d6f9d0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:54.950837 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6b5cdccf-9adb-4da8-a658-bcd194d6f9d0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.163046 Jul 18 02:40:54.951445 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 400/801] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:54 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:55.280386 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-467543e8-5b6a-4e3b-a799-fb14a6c08461 req-29bbc018-a294-46c9-9fa9-9388f927183e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85324481-a04a-4d16-b72d-6a355b0775d0", "tag": "09ed14d6-d57e-45f3-ae2a-c4a16c9aba4d"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:55.288373 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-467543e8-5b6a-4e3b-a799-fb14a6c08461 req-29bbc018-a294-46c9-9fa9-9388f927183e service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:55.300567 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-467543e8-5b6a-4e3b-a799-fb14a6c08461 req-29bbc018-a294-46c9-9fa9-9388f927183e service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:55.300567 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-467543e8-5b6a-4e3b-a799-fb14a6c08461 req-29bbc018-a294-46c9-9fa9-9388f927183e service nova] Creating event network-changed:09ed14d6-d57e-45f3-ae2a-c4a16c9aba4d for instance 85324481-a04a-4d16-b72d-6a355b0775d0 on hv-cinder-85001 Jul 18 02:40:55.305157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-467543e8-5b6a-4e3b-a799-fb14a6c08461 req-29bbc018-a294-46c9-9fa9-9388f927183e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088290 Jul 18 02:40:55.305751 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 402/802] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:55.643727 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-728e06a1-f6a7-4985-8b25-b33e75ac8da9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:55.643925 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-728e06a1-f6a7-4985-8b25-b33e75ac8da9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:55.650485 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-728e06a1-f6a7-4985-8b25-b33e75ac8da9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:55.650961 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-728e06a1-f6a7-4985-8b25-b33e75ac8da9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:55.651798 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-728e06a1-f6a7-4985-8b25-b33e75ac8da9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:55.652233 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-728e06a1-f6a7-4985-8b25-b33e75ac8da9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:55.783598 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-728e06a1-f6a7-4985-8b25-b33e75ac8da9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:55.785886 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:55.792605 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-728e06a1-f6a7-4985-8b25-b33e75ac8da9 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.153285 Jul 18 02:40:55.793218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 401/803] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:55 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:40:55.971039 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3f0f137b-f115-48f2-8803-9182d4024606 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:55.971773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3f0f137b-f115-48f2-8803-9182d4024606 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:55.978859 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3f0f137b-f115-48f2-8803-9182d4024606 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:55.979314 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3f0f137b-f115-48f2-8803-9182d4024606 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:55.980117 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3f0f137b-f115-48f2-8803-9182d4024606 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:55.980556 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3f0f137b-f115-48f2-8803-9182d4024606 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:56.128619 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3f0f137b-f115-48f2-8803-9182d4024606 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:56.137466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3f0f137b-f115-48f2-8803-9182d4024606 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:56.138984 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3f0f137b-f115-48f2-8803-9182d4024606 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:56.140239 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3f0f137b-f115-48f2-8803-9182d4024606 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.174285 Jul 18 02:40:56.140833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 403/804] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:55 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:56.810519 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8bacbc8a-69f5-42d7-9645-a60ead3c437c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:56.811131 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8bacbc8a-69f5-42d7-9645-a60ead3c437c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:56.817978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8bacbc8a-69f5-42d7-9645-a60ead3c437c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:56.818459 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8bacbc8a-69f5-42d7-9645-a60ead3c437c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:56.819227 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8bacbc8a-69f5-42d7-9645-a60ead3c437c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:56.819668 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8bacbc8a-69f5-42d7-9645-a60ead3c437c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:56.953069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8bacbc8a-69f5-42d7-9645-a60ead3c437c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:56.961235 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8bacbc8a-69f5-42d7-9645-a60ead3c437c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.155225 Jul 18 02:40:56.961804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 402/805] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:56 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:57.159234 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c8a30b44-7f70-4ba5-bd10-2de42ab5bde2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:57.159874 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c8a30b44-7f70-4ba5-bd10-2de42ab5bde2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:57.166559 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8a30b44-7f70-4ba5-bd10-2de42ab5bde2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:57.167008 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8a30b44-7f70-4ba5-bd10-2de42ab5bde2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:57.167764 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8a30b44-7f70-4ba5-bd10-2de42ab5bde2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:57.168368 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8a30b44-7f70-4ba5-bd10-2de42ab5bde2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:57.298351 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c8a30b44-7f70-4ba5-bd10-2de42ab5bde2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:57.306298 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c8a30b44-7f70-4ba5-bd10-2de42ab5bde2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:57.308051 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c8a30b44-7f70-4ba5-bd10-2de42ab5bde2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:57.309200 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c8a30b44-7f70-4ba5-bd10-2de42ab5bde2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.153881 Jul 18 02:40:57.309758 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 404/806] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:57 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:57.979028 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b0ba7b1e-93af-419e-9bf4-6eb17d26d589 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:57.979811 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b0ba7b1e-93af-419e-9bf4-6eb17d26d589 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:57.986497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b0ba7b1e-93af-419e-9bf4-6eb17d26d589 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:57.986955 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b0ba7b1e-93af-419e-9bf4-6eb17d26d589 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:57.987737 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b0ba7b1e-93af-419e-9bf4-6eb17d26d589 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:57.988179 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b0ba7b1e-93af-419e-9bf4-6eb17d26d589 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:58.279432 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b0ba7b1e-93af-419e-9bf4-6eb17d26d589 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:58.288934 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b0ba7b1e-93af-419e-9bf4-6eb17d26d589 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1521 microversion: 2.1 time: 0.314729 Jul 18 02:40:58.289521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 403/807] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:57 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:58.328057 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-54914012-c0ae-47d0-a95e-33f7111efaae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:58.328874 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-54914012-c0ae-47d0-a95e-33f7111efaae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:58.340200 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-54914012-c0ae-47d0-a95e-33f7111efaae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:58.340659 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-54914012-c0ae-47d0-a95e-33f7111efaae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:58.341444 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-54914012-c0ae-47d0-a95e-33f7111efaae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:58.341882 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-54914012-c0ae-47d0-a95e-33f7111efaae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:58.494474 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-54914012-c0ae-47d0-a95e-33f7111efaae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:58.502551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-54914012-c0ae-47d0-a95e-33f7111efaae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:58.503971 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-54914012-c0ae-47d0-a95e-33f7111efaae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:58.505121 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-54914012-c0ae-47d0-a95e-33f7111efaae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.181765 Jul 18 02:40:58.506401 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 405/808] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:58 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:40:58.923499 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-521a1883-e888-4d8f-a5aa-111cea199d70 req-57a2692c-154c-4c87-bcb4-547f96bb5b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7f8048-6316-49a6-89a0-2b5113d7d9f8", "name": "network-vif-deleted", "tag": "caf2e138-8e60-4fcf-8119-71c69a88ae7d"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:40:58.932446 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-521a1883-e888-4d8f-a5aa-111cea199d70 req-57a2692c-154c-4c87-bcb4-547f96bb5b21 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:58.932924 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-521a1883-e888-4d8f-a5aa-111cea199d70 req-57a2692c-154c-4c87-bcb4-547f96bb5b21 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:58.945677 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-521a1883-e888-4d8f-a5aa-111cea199d70 req-57a2692c-154c-4c87-bcb4-547f96bb5b21 service nova] Creating event network-vif-deleted:caf2e138-8e60-4fcf-8119-71c69a88ae7d for instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 on hv-cinder-85001 Jul 18 02:40:58.950440 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-521a1883-e888-4d8f-a5aa-111cea199d70 req-57a2692c-154c-4c87-bcb4-547f96bb5b21 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030638 Jul 18 02:40:58.951029 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 404/809] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:40:59.308323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:59.308942 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:59.315319 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:59.315774 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:59.316660 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:59.317133 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:59.350200 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:59.350813 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:59.351101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lazy-loading 'fault' on Instance uuid 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:40:59.392402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd281c92e20d04004a679a8ec65f9e6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec4c1c1687944b98c1c5cefe05df095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:59.399916 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c5002a06-0bde-4a56-9edb-4945b1c45789 tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 200 len: 1311 microversion: 2.1 time: 0.097436 Jul 18 02:40:59.400470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 406/810] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:40:59 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:40:59.524492 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8892734e-f080-44ea-b14c-5af2d879ecf0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:40:59.525086 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8892734e-f080-44ea-b14c-5af2d879ecf0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:40:59.531269 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8892734e-f080-44ea-b14c-5af2d879ecf0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:59.531719 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8892734e-f080-44ea-b14c-5af2d879ecf0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:59.532482 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8892734e-f080-44ea-b14c-5af2d879ecf0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:40:59.532914 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8892734e-f080-44ea-b14c-5af2d879ecf0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:40:59.667310 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8892734e-f080-44ea-b14c-5af2d879ecf0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:59.676232 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8892734e-f080-44ea-b14c-5af2d879ecf0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:59.678454 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8892734e-f080-44ea-b14c-5af2d879ecf0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:40:59.679638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8892734e-f080-44ea-b14c-5af2d879ecf0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.160093 Jul 18 02:40:59.680184 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 405/811] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:40:59 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:00.416738 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f5a0a34d-d5f6-4012-a8a2-983b4a75fd0c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:00.417343 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f5a0a34d-d5f6-4012-a8a2-983b4a75fd0c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] [instance: 8f7f8048-6316-49a6-89a0-2b5113d7d9f8] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:00.423828 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f5a0a34d-d5f6-4012-a8a2-983b4a75fd0c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:00.424306 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f5a0a34d-d5f6-4012-a8a2-983b4a75fd0c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:00.425060 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f5a0a34d-d5f6-4012-a8a2-983b4a75fd0c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:00.425491 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f5a0a34d-d5f6-4012-a8a2-983b4a75fd0c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:00.438858 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-f5a0a34d-d5f6-4012-a8a2-983b4a75fd0c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] HTTP exception thrown: Instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 could not be found. Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f5a0a34d-d5f6-4012-a8a2-983b4a75fd0c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Request method failure captured: Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 HTTP/1.1 Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1McuPtx3mXnBtnAQz6hcyUDMQQKVKo-T7dvPGtmZuTuHw7GzvsTn0I34zu4yEdIofz-yDNRRgXDEBOkIkJBrQ94epik1LKFvkwOHcowjlukXqP9m0auyRN8lNxgEcAPqwnRsqanPw5IYVJ7_ivL4Sbf9V6H62dfIQ2mbExpaWFvVh-Y Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 9ec4c1c1687944b98c1c5cefe05df095 Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:41:00.440476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ec4c1c1687944b98c1c5cefe05df095"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9ec4c1c1687944b98c1c5cefe05df095", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 9ec4c1c1687944b98c1c5cefe05df095 Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-988773994 Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-ServerRescueNegativeTestJSON-988773994-project Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: d281c92e20d04004a679a8ec65f9e6d5 Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-ServerRescueNegativeTestJSON-988773994-project Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 could not be found. Jul 18 02:41:00.442028 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '8f7f8048-6316-49a6-89a0-2b5113d7d9f8'} Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 could not be found. Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:00.450580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 could not be found. Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 could not be found. Jul 18 02:41:00.452565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:41:00.454177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f5a0a34d-d5f6-4012-a8a2-983b4a75fd0c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] Returning 404 to user: Instance 8f7f8048-6316-49a6-89a0-2b5113d7d9f8 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:00.454177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f5a0a34d-d5f6-4012-a8a2-983b4a75fd0c tempest-ServerRescueNegativeTestJSON-988773994 tempest-ServerRescueNegativeTestJSON-988773994-project] 10.222.0.66 "GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8" status: 404 len: 111 microversion: 2.1 time: 0.028943 Jul 18 02:41:00.454177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 407/812] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:00 2022] GET /compute/v2.1/servers/8f7f8048-6316-49a6-89a0-2b5113d7d9f8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:00.698054 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3ff15388-6b59-4526-b34c-59bb36d765fb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:00.698662 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3ff15388-6b59-4526-b34c-59bb36d765fb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:00.705157 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ff15388-6b59-4526-b34c-59bb36d765fb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:00.705611 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ff15388-6b59-4526-b34c-59bb36d765fb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:00.706407 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ff15388-6b59-4526-b34c-59bb36d765fb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:00.706851 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ff15388-6b59-4526-b34c-59bb36d765fb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:00.847067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3ff15388-6b59-4526-b34c-59bb36d765fb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:00.856978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3ff15388-6b59-4526-b34c-59bb36d765fb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:00.859347 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3ff15388-6b59-4526-b34c-59bb36d765fb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:00.861085 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3ff15388-6b59-4526-b34c-59bb36d765fb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.166751 Jul 18 02:41:00.861669 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 406/813] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:00 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:01.879707 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-08240577-1339-4bd0-939c-c5de65c4f6b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:01.880351 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-08240577-1339-4bd0-939c-c5de65c4f6b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:01.887199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-08240577-1339-4bd0-939c-c5de65c4f6b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:01.887656 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-08240577-1339-4bd0-939c-c5de65c4f6b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:01.888433 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-08240577-1339-4bd0-939c-c5de65c4f6b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:01.888872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-08240577-1339-4bd0-939c-c5de65c4f6b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:02.110766 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-08240577-1339-4bd0-939c-c5de65c4f6b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:02.119268 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-08240577-1339-4bd0-939c-c5de65c4f6b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:02.120743 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-08240577-1339-4bd0-939c-c5de65c4f6b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:02.121880 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-08240577-1339-4bd0-939c-c5de65c4f6b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.246144 Jul 18 02:41:02.122472 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 408/814] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:01 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:03.143137 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f0b6cd7b-a536-4c58-b5f9-651b6bc9612d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:03.143748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f0b6cd7b-a536-4c58-b5f9-651b6bc9612d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:03.150424 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b6cd7b-a536-4c58-b5f9-651b6bc9612d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:03.150967 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b6cd7b-a536-4c58-b5f9-651b6bc9612d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:03.151739 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b6cd7b-a536-4c58-b5f9-651b6bc9612d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:03.152175 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b6cd7b-a536-4c58-b5f9-651b6bc9612d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:03.295844 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f0b6cd7b-a536-4c58-b5f9-651b6bc9612d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:03.305869 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f0b6cd7b-a536-4c58-b5f9-651b6bc9612d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:03.307897 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f0b6cd7b-a536-4c58-b5f9-651b6bc9612d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:03.309972 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f0b6cd7b-a536-4c58-b5f9-651b6bc9612d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.170952 Jul 18 02:41:03.310676 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 407/815] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:03 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:04.329083 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e5765902-6f64-40a3-8dc2-a2c9e56042c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:04.329746 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e5765902-6f64-40a3-8dc2-a2c9e56042c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:04.337209 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e5765902-6f64-40a3-8dc2-a2c9e56042c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:04.337793 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e5765902-6f64-40a3-8dc2-a2c9e56042c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:04.338667 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e5765902-6f64-40a3-8dc2-a2c9e56042c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:04.339678 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e5765902-6f64-40a3-8dc2-a2c9e56042c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:04.487994 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e5765902-6f64-40a3-8dc2-a2c9e56042c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:04.496017 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e5765902-6f64-40a3-8dc2-a2c9e56042c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:04.497502 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e5765902-6f64-40a3-8dc2-a2c9e56042c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:04.498692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e5765902-6f64-40a3-8dc2-a2c9e56042c1 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.173745 Jul 18 02:41:04.499266 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 409/816] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:04 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:05.517573 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-943c026c-95e0-4e18-968d-ec0910063bd7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:05.518201 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-943c026c-95e0-4e18-968d-ec0910063bd7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:05.525147 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-943c026c-95e0-4e18-968d-ec0910063bd7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:05.525588 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-943c026c-95e0-4e18-968d-ec0910063bd7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:05.526407 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-943c026c-95e0-4e18-968d-ec0910063bd7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:05.526864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-943c026c-95e0-4e18-968d-ec0910063bd7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:05.663459 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-943c026c-95e0-4e18-968d-ec0910063bd7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:05.674810 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-943c026c-95e0-4e18-968d-ec0910063bd7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:05.674810 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-943c026c-95e0-4e18-968d-ec0910063bd7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:05.674810 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-943c026c-95e0-4e18-968d-ec0910063bd7 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1743 microversion: 2.20 time: 0.161080 Jul 18 02:41:05.675663 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 408/817] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:05 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:06.694003 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-594249f9-c57f-4c18-adf2-51fbee2ca97d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:06.694645 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-594249f9-c57f-4c18-adf2-51fbee2ca97d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:06.701057 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-594249f9-c57f-4c18-adf2-51fbee2ca97d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:06.701500 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-594249f9-c57f-4c18-adf2-51fbee2ca97d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:06.702314 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-594249f9-c57f-4c18-adf2-51fbee2ca97d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:06.702754 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-594249f9-c57f-4c18-adf2-51fbee2ca97d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:06.835977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-594249f9-c57f-4c18-adf2-51fbee2ca97d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:06.844142 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-594249f9-c57f-4c18-adf2-51fbee2ca97d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:06.845631 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-594249f9-c57f-4c18-adf2-51fbee2ca97d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:06.846801 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-594249f9-c57f-4c18-adf2-51fbee2ca97d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1743 microversion: 2.20 time: 0.156598 Jul 18 02:41:06.847362 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 410/818] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:06 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:07.871255 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-66c7d7c0-0192-464f-938d-9ea26d2c9998 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:07.872659 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-66c7d7c0-0192-464f-938d-9ea26d2c9998 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:07.879333 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-66c7d7c0-0192-464f-938d-9ea26d2c9998 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:07.879857 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-66c7d7c0-0192-464f-938d-9ea26d2c9998 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:07.880736 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-66c7d7c0-0192-464f-938d-9ea26d2c9998 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:07.881533 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-66c7d7c0-0192-464f-938d-9ea26d2c9998 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:08.030189 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-66c7d7c0-0192-464f-938d-9ea26d2c9998 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:08.042278 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-66c7d7c0-0192-464f-938d-9ea26d2c9998 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:08.045030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-66c7d7c0-0192-464f-938d-9ea26d2c9998 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:08.046443 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-66c7d7c0-0192-464f-938d-9ea26d2c9998 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.179642 Jul 18 02:41:08.047453 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 409/819] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:07 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:08.281685 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-af9cfb75-d55b-450e-8b0f-3e6649871b40 req-c1dce4b0-2b36-4fea-8798-ab5411fb9fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a", "name": "network-vif-plugged", "status": "completed", "tag": "078d1890-a0ab-46d1-ac2c-464bd6da369c"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:08.291258 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-af9cfb75-d55b-450e-8b0f-3e6649871b40 req-c1dce4b0-2b36-4fea-8798-ab5411fb9fd8 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:08.303239 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-af9cfb75-d55b-450e-8b0f-3e6649871b40 req-c1dce4b0-2b36-4fea-8798-ab5411fb9fd8 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:08.319289 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-af9cfb75-d55b-450e-8b0f-3e6649871b40 req-c1dce4b0-2b36-4fea-8798-ab5411fb9fd8 service nova] Creating event network-vif-plugged:078d1890-a0ab-46d1-ac2c-464bd6da369c for instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a on hv-cinder-85001 Jul 18 02:41:08.325466 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-af9cfb75-d55b-450e-8b0f-3e6649871b40 req-c1dce4b0-2b36-4fea-8798-ab5411fb9fd8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048112 Jul 18 02:41:08.326276 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 411/820] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:09.066801 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d9238f14-6dea-4c7e-b372-a57f6cd90cfc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:09.067409 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d9238f14-6dea-4c7e-b372-a57f6cd90cfc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:09.076897 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9238f14-6dea-4c7e-b372-a57f6cd90cfc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:09.077424 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9238f14-6dea-4c7e-b372-a57f6cd90cfc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:09.078275 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9238f14-6dea-4c7e-b372-a57f6cd90cfc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:09.078899 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9238f14-6dea-4c7e-b372-a57f6cd90cfc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:09.239931 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d9238f14-6dea-4c7e-b372-a57f6cd90cfc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:09.249761 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d9238f14-6dea-4c7e-b372-a57f6cd90cfc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:09.251615 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d9238f14-6dea-4c7e-b372-a57f6cd90cfc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:09.252975 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d9238f14-6dea-4c7e-b372-a57f6cd90cfc tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.191711 Jul 18 02:41:09.267272 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 410/821] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:09 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:41:10.276161 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fa6b0a97-eed9-4b7a-95ab-143f25a19b7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:10.278285 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fa6b0a97-eed9-4b7a-95ab-143f25a19b7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:10.287915 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa6b0a97-eed9-4b7a-95ab-143f25a19b7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:10.288414 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa6b0a97-eed9-4b7a-95ab-143f25a19b7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:10.289426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa6b0a97-eed9-4b7a-95ab-143f25a19b7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:10.289906 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa6b0a97-eed9-4b7a-95ab-143f25a19b7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:10.448043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fa6b0a97-eed9-4b7a-95ab-143f25a19b7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:10.457449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fa6b0a97-eed9-4b7a-95ab-143f25a19b7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:10.459843 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fa6b0a97-eed9-4b7a-95ab-143f25a19b7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:10.461012 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fa6b0a97-eed9-4b7a-95ab-143f25a19b7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.190106 Jul 18 02:41:10.471988 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 412/822] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:10 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:11.480489 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a422de20-61e8-40fc-b8ed-40c0085df72d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:11.482258 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a422de20-61e8-40fc-b8ed-40c0085df72d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:11.495521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a422de20-61e8-40fc-b8ed-40c0085df72d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:11.496058 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a422de20-61e8-40fc-b8ed-40c0085df72d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:11.496846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a422de20-61e8-40fc-b8ed-40c0085df72d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:11.497362 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a422de20-61e8-40fc-b8ed-40c0085df72d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:11.665510 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a422de20-61e8-40fc-b8ed-40c0085df72d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:11.675793 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a422de20-61e8-40fc-b8ed-40c0085df72d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:11.685653 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a422de20-61e8-40fc-b8ed-40c0085df72d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:11.685653 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a422de20-61e8-40fc-b8ed-40c0085df72d tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.202920 Jul 18 02:41:11.685653 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 411/823] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:11 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:12.701050 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9f4596f1-1954-4ff6-9cc6-4e4c3dee5421 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:12.701872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9f4596f1-1954-4ff6-9cc6-4e4c3dee5421 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:12.709533 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f4596f1-1954-4ff6-9cc6-4e4c3dee5421 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:12.710335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f4596f1-1954-4ff6-9cc6-4e4c3dee5421 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:12.711330 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f4596f1-1954-4ff6-9cc6-4e4c3dee5421 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:12.711925 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9f4596f1-1954-4ff6-9cc6-4e4c3dee5421 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:12.731439 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:12.862711 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9f4596f1-1954-4ff6-9cc6-4e4c3dee5421 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:12.871252 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9f4596f1-1954-4ff6-9cc6-4e4c3dee5421 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:12.873175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9f4596f1-1954-4ff6-9cc6-4e4c3dee5421 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:12.874442 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9f4596f1-1954-4ff6-9cc6-4e4c3dee5421 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.180139 Jul 18 02:41:12.875072 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 413/824] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:12 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:13.893073 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d79f2a15-adb5-4b47-9987-b6def4c57a49 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:13.893809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d79f2a15-adb5-4b47-9987-b6def4c57a49 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:13.901993 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d79f2a15-adb5-4b47-9987-b6def4c57a49 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:13.902801 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d79f2a15-adb5-4b47-9987-b6def4c57a49 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:13.903603 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d79f2a15-adb5-4b47-9987-b6def4c57a49 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:13.904208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d79f2a15-adb5-4b47-9987-b6def4c57a49 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:14.043761 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d79f2a15-adb5-4b47-9987-b6def4c57a49 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:14.051849 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d79f2a15-adb5-4b47-9987-b6def4c57a49 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:14.054134 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d79f2a15-adb5-4b47-9987-b6def4c57a49 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:14.055315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d79f2a15-adb5-4b47-9987-b6def4c57a49 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.166335 Jul 18 02:41:14.055866 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 412/825] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:13 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:15.073176 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-71a0d519-90ee-4353-9915-b33beb0aa0d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:15.073781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-71a0d519-90ee-4353-9915-b33beb0aa0d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:15.081911 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=58 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:15.083869 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-71a0d519-90ee-4353-9915-b33beb0aa0d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.084497 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-71a0d519-90ee-4353-9915-b33beb0aa0d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:15.085973 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-71a0d519-90ee-4353-9915-b33beb0aa0d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.086486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-71a0d519-90ee-4353-9915-b33beb0aa0d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:15.231085 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-71a0d519-90ee-4353-9915-b33beb0aa0d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:15.240746 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-71a0d519-90ee-4353-9915-b33beb0aa0d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:15.242852 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-71a0d519-90ee-4353-9915-b33beb0aa0d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:15.244277 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-71a0d519-90ee-4353-9915-b33beb0aa0d4 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.175109 Jul 18 02:41:15.245412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 414/826] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:15 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:15.471254 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8ff3c05d-3b11-4eb3-a8cf-1eb5698353ec tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:15.472355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8ff3c05d-3b11-4eb3-a8cf-1eb5698353ec tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:15.480429 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ff3c05d-3b11-4eb3-a8cf-1eb5698353ec tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.481153 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ff3c05d-3b11-4eb3-a8cf-1eb5698353ec tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:15.481928 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ff3c05d-3b11-4eb3-a8cf-1eb5698353ec tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.482414 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8ff3c05d-3b11-4eb3-a8cf-1eb5698353ec tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:15.509653 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8ff3c05d-3b11-4eb3-a8cf-1eb5698353ec tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:41:15.814599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8ff3c05d-3b11-4eb3-a8cf-1eb5698353ec tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 204 len: 0 microversion: 2.1 time: 0.348106 Jul 18 02:41:15.815200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 413/827] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:41:15 2022] DELETE /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:41:15.823536 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-737cf7d1-d3d0-4a78-b2c1-0064149cdc08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:15.824459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-737cf7d1-d3d0-4a78-b2c1-0064149cdc08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:15.838645 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-737cf7d1-d3d0-4a78-b2c1-0064149cdc08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.839321 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-737cf7d1-d3d0-4a78-b2c1-0064149cdc08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:15.840130 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-737cf7d1-d3d0-4a78-b2c1-0064149cdc08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:15.840570 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-737cf7d1-d3d0-4a78-b2c1-0064149cdc08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:15.994127 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-737cf7d1-d3d0-4a78-b2c1-0064149cdc08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:16.005342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-737cf7d1-d3d0-4a78-b2c1-0064149cdc08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1577 microversion: 2.1 time: 0.185670 Jul 18 02:41:16.010756 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 415/828] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:15 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:16.265151 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-adaaa0b5-bca1-47dd-a640-e22eb875260e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:16.265806 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-adaaa0b5-bca1-47dd-a640-e22eb875260e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:16.272013 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-adaaa0b5-bca1-47dd-a640-e22eb875260e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:16.272722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-adaaa0b5-bca1-47dd-a640-e22eb875260e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:16.273626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-adaaa0b5-bca1-47dd-a640-e22eb875260e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:16.274058 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-adaaa0b5-bca1-47dd-a640-e22eb875260e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:16.441318 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-adaaa0b5-bca1-47dd-a640-e22eb875260e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:16.455094 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-adaaa0b5-bca1-47dd-a640-e22eb875260e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:16.457198 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-adaaa0b5-bca1-47dd-a640-e22eb875260e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:16.458770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-adaaa0b5-bca1-47dd-a640-e22eb875260e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.198136 Jul 18 02:41:16.470170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 414/829] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:16 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:17.025604 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-103145ca-1031-47f8-af27-37b61b9cdce4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:17.026456 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-103145ca-1031-47f8-af27-37b61b9cdce4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:17.033987 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-103145ca-1031-47f8-af27-37b61b9cdce4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:17.037077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-103145ca-1031-47f8-af27-37b61b9cdce4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:17.038450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-103145ca-1031-47f8-af27-37b61b9cdce4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:17.038725 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-103145ca-1031-47f8-af27-37b61b9cdce4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:17.196022 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-103145ca-1031-47f8-af27-37b61b9cdce4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:17.205239 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-103145ca-1031-47f8-af27-37b61b9cdce4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1577 microversion: 2.1 time: 0.184762 Jul 18 02:41:17.206033 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 416/830] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:17 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:17.477407 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bafbf5cf-e0f5-4f0f-82d5-5e0f9d9d0f7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:17.478017 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bafbf5cf-e0f5-4f0f-82d5-5e0f9d9d0f7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:17.484578 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bafbf5cf-e0f5-4f0f-82d5-5e0f9d9d0f7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:17.485030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bafbf5cf-e0f5-4f0f-82d5-5e0f9d9d0f7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:17.485784 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bafbf5cf-e0f5-4f0f-82d5-5e0f9d9d0f7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:17.486311 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bafbf5cf-e0f5-4f0f-82d5-5e0f9d9d0f7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:17.622773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bafbf5cf-e0f5-4f0f-82d5-5e0f9d9d0f7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:17.630694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bafbf5cf-e0f5-4f0f-82d5-5e0f9d9d0f7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:17.632470 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bafbf5cf-e0f5-4f0f-82d5-5e0f9d9d0f7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:17.633640 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bafbf5cf-e0f5-4f0f-82d5-5e0f9d9d0f7c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.160760 Jul 18 02:41:17.634228 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 415/831] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:17 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:18.226679 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f2570cae-53ac-45c3-80cf-0234804100ac tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:18.226679 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f2570cae-53ac-45c3-80cf-0234804100ac tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:18.231875 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2570cae-53ac-45c3-80cf-0234804100ac tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:18.232542 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2570cae-53ac-45c3-80cf-0234804100ac tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:18.234805 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2570cae-53ac-45c3-80cf-0234804100ac tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:18.235809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f2570cae-53ac-45c3-80cf-0234804100ac tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:18.393550 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f2570cae-53ac-45c3-80cf-0234804100ac tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:18.402690 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f2570cae-53ac-45c3-80cf-0234804100ac tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1577 microversion: 2.1 time: 0.183205 Jul 18 02:41:18.405576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 417/832] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:18 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:18.652416 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d4bb4d41-96bc-41d6-a620-28b094ed1e13 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:18.653827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d4bb4d41-96bc-41d6-a620-28b094ed1e13 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:18.663757 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d4bb4d41-96bc-41d6-a620-28b094ed1e13 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:18.673576 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d4bb4d41-96bc-41d6-a620-28b094ed1e13 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:18.676756 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d4bb4d41-96bc-41d6-a620-28b094ed1e13 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:18.677501 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d4bb4d41-96bc-41d6-a620-28b094ed1e13 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:18.893129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d4bb4d41-96bc-41d6-a620-28b094ed1e13 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:18.921242 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d4bb4d41-96bc-41d6-a620-28b094ed1e13 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:18.927403 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d4bb4d41-96bc-41d6-a620-28b094ed1e13 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:18.931504 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d4bb4d41-96bc-41d6-a620-28b094ed1e13 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.282953 Jul 18 02:41:18.954454 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 416/833] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:18 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:19.023241 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-3891eed3-1e2e-48a2-890e-a1ebbd1a74f1 req-82353827-f5dd-4bb6-871c-a50dd4074026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7697d1-40ec-4c17-979a-de45d737eac5", "name": "network-vif-deleted", "tag": "3ff30934-3b2b-494c-bbcf-58c1f9f9094e"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:19.032790 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-3891eed3-1e2e-48a2-890e-a1ebbd1a74f1 req-82353827-f5dd-4bb6-871c-a50dd4074026 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:19.040055 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-3891eed3-1e2e-48a2-890e-a1ebbd1a74f1 req-82353827-f5dd-4bb6-871c-a50dd4074026 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:19.064319 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-3891eed3-1e2e-48a2-890e-a1ebbd1a74f1 req-82353827-f5dd-4bb6-871c-a50dd4074026 service nova] Creating event network-vif-deleted:3ff30934-3b2b-494c-bbcf-58c1f9f9094e for instance fb7697d1-40ec-4c17-979a-de45d737eac5 on hv-cinder-85001 Jul 18 02:41:19.072085 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-3891eed3-1e2e-48a2-890e-a1ebbd1a74f1 req-82353827-f5dd-4bb6-871c-a50dd4074026 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054175 Jul 18 02:41:19.078065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 418/834] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:41:19.423326 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c3999cf3-8699-4ec8-93c7-6558f68f4219 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:19.423945 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c3999cf3-8699-4ec8-93c7-6558f68f4219 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:19.430203 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c3999cf3-8699-4ec8-93c7-6558f68f4219 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:19.430659 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c3999cf3-8699-4ec8-93c7-6558f68f4219 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:19.431457 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c3999cf3-8699-4ec8-93c7-6558f68f4219 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:19.431898 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c3999cf3-8699-4ec8-93c7-6558f68f4219 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:19.447024 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:19.495594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c3999cf3-8699-4ec8-93c7-6558f68f4219 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:19.503262 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c3999cf3-8699-4ec8-93c7-6558f68f4219 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1224 microversion: 2.1 time: 0.083850 Jul 18 02:41:19.503839 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 417/835] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:19 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:19.954172 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2e624e8d-60e7-4a29-bc57-80f1b609591c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:19.954872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2e624e8d-60e7-4a29-bc57-80f1b609591c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:19.961822 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2e624e8d-60e7-4a29-bc57-80f1b609591c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:19.962311 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2e624e8d-60e7-4a29-bc57-80f1b609591c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:19.963105 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2e624e8d-60e7-4a29-bc57-80f1b609591c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:19.963591 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2e624e8d-60e7-4a29-bc57-80f1b609591c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.107103 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2e624e8d-60e7-4a29-bc57-80f1b609591c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:20.113573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2e624e8d-60e7-4a29-bc57-80f1b609591c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:20.115191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2e624e8d-60e7-4a29-bc57-80f1b609591c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:20.116896 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2e624e8d-60e7-4a29-bc57-80f1b609591c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1738 microversion: 2.20 time: 0.167741 Jul 18 02:41:20.117445 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 419/836] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:19 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:20.520089 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:20.520702 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:20.527597 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:20.528051 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.528813 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:20.529251 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.561163 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:20.561615 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:20.562062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lazy-loading 'fault' on Instance uuid fb7697d1-40ec-4c17-979a-de45d737eac5 {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:41:20.606830 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:20.614603 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-89a456db-e064-4110-9ad1-d867b6b58c2c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 200 len: 1229 microversion: 2.1 time: 0.098785 Jul 18 02:41:20.620033 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 418/837] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:20 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:21.135152 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-daf6d1f0-87ba-4f1e-864e-7ddd522d4740 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:21.135769 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-daf6d1f0-87ba-4f1e-864e-7ddd522d4740 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:21.142412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-daf6d1f0-87ba-4f1e-864e-7ddd522d4740 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:21.142868 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-daf6d1f0-87ba-4f1e-864e-7ddd522d4740 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:21.143641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-daf6d1f0-87ba-4f1e-864e-7ddd522d4740 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:21.144084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-daf6d1f0-87ba-4f1e-864e-7ddd522d4740 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:21.277668 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-daf6d1f0-87ba-4f1e-864e-7ddd522d4740 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:21.285794 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-daf6d1f0-87ba-4f1e-864e-7ddd522d4740 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:21.287442 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-daf6d1f0-87ba-4f1e-864e-7ddd522d4740 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:21.289086 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-daf6d1f0-87ba-4f1e-864e-7ddd522d4740 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1720 microversion: 2.20 time: 0.158397 Jul 18 02:41:21.290854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 420/838] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:21 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:21.364786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-85963bbb-2d34-4b5c-97de-7ee720f9feb5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:21.365400 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-85963bbb-2d34-4b5c-97de-7ee720f9feb5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:21.371485 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-85963bbb-2d34-4b5c-97de-7ee720f9feb5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:21.371943 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-85963bbb-2d34-4b5c-97de-7ee720f9feb5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:21.372714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-85963bbb-2d34-4b5c-97de-7ee720f9feb5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:21.373152 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-85963bbb-2d34-4b5c-97de-7ee720f9feb5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:21.396218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-85963bbb-2d34-4b5c-97de-7ee720f9feb5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/ips" status: 200 len: 145 microversion: 2.1 time: 0.035357 Jul 18 02:41:21.398136 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 419/839] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 18 02:41:21 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:21.631372 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-12a6e2fc-7d3c-40e7-be52-a6eef6b229d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:21.632687 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-12a6e2fc-7d3c-40e7-be52-a6eef6b229d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:21.638838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-12a6e2fc-7d3c-40e7-be52-a6eef6b229d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:21.639298 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-12a6e2fc-7d3c-40e7-be52-a6eef6b229d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:21.640069 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-12a6e2fc-7d3c-40e7-be52-a6eef6b229d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:21.640512 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-12a6e2fc-7d3c-40e7-be52-a6eef6b229d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:21.653967 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-12a6e2fc-7d3c-40e7-be52-a6eef6b229d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] HTTP exception thrown: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-12a6e2fc-7d3c-40e7-be52-a6eef6b229d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Request method failure captured: Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 HTTP/1.1 Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MdxaPdbAazZUjAbFLfDD-BhuS0wZmHyZWnJFNNV8MI8fuxJbmVympsiuxnwmNE6ch6KfpCH1DYfIbYNTqQHTFyHLN2g8HbEiWT8ZIoav6ekZ_p8oN_jjSHxG9I2rbxTRlMVA0GzZ8cfv75mbVYcFrrffaqPLaVo0JMbLozvzr75mNs Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 807f88779cf842f3bbe09615d470f44c Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:41:21.655630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_807f88779cf842f3bbe09615d470f44c", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 807f88779cf842f3bbe09615d470f44c Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-TestVolumeBootPattern-1838735271-project Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 41a452eca3af46b09f56a80fa8652247 Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-TestVolumeBootPattern-1838735271-project Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:41:21.657480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'fb7697d1-40ec-4c17-979a-de45d737eac5'} Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:41:21.658590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:41:21.660157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:41:21.661533 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-12a6e2fc-7d3c-40e7-be52-a6eef6b229d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Returning 404 to user: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:41:21.661533 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-12a6e2fc-7d3c-40e7-be52-a6eef6b229d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 404 len: 111 microversion: 2.1 time: 0.029503 Jul 18 02:41:21.661533 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 421/840] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:21 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:21.752399 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1862358893", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-530523020", "security_groups": [{"name": "tempest-secgroup-smoke-1668344787"}], "block_device_mapping_v2": [{"uuid": "8e991827-7b88-455b-af25-cf5a45d157f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "40df86f1-859f-4d28-af05-d94fe8d1d2ea"}]}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:21.869773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] validate_networks() for [('40df86f1-859f-4d28-af05-d94fe8d1d2ea', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:41:22.311619 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4f957e77-0899-4135-884a-f8ffdb4791b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:22.312380 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4f957e77-0899-4135-884a-f8ffdb4791b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:22.320183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4f957e77-0899-4135-884a-f8ffdb4791b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:22.320640 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4f957e77-0899-4135-884a-f8ffdb4791b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:22.321432 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4f957e77-0899-4135-884a-f8ffdb4791b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:22.321870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4f957e77-0899-4135-884a-f8ffdb4791b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:22.461589 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4f957e77-0899-4135-884a-f8ffdb4791b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:22.470234 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4f957e77-0899-4135-884a-f8ffdb4791b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:22.471731 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4f957e77-0899-4135-884a-f8ffdb4791b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:22.472891 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4f957e77-0899-4135-884a-f8ffdb4791b3 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1720 microversion: 2.20 time: 0.165816 Jul 18 02:41:22.473445 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 422/841] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:22 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:41:22.516942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:41:22.517363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:41:22.517865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:41:22.518411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:41:22.519175 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:41:22.528189 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:22.528630 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:22.529319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:22.529753 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:22.546425 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Getting quotas for project 807f88779cf842f3bbe09615d470f44c. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:41:22.550983 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Getting quotas for user 41a452eca3af46b09f56a80fa8652247 and project 807f88779cf842f3bbe09615d470f44c. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:41:22.614413 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:41:22.614413 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e991827-7b88-455b-af25-cf5a45d157f2',volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:41:23.091078 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d04cdd6a-58e8-4c87-a806-c22cbdf2d8c3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac671bbd-431f-4b08-8664-846a41169628"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:23.092152 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d04cdd6a-58e8-4c87-a806-c22cbdf2d8c3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:23.098103 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d04cdd6a-58e8-4c87-a806-c22cbdf2d8c3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:23.098562 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d04cdd6a-58e8-4c87-a806-c22cbdf2d8c3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:23.099426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d04cdd6a-58e8-4c87-a806-c22cbdf2d8c3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:23.099932 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d04cdd6a-58e8-4c87-a806-c22cbdf2d8c3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:23.115525 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-46e2adaf-e357-4f2e-8285-246812d111c1 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.367059 Jul 18 02:41:23.121319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 420/842] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:41:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:41:23.126061 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b77ffa9c-a6e6-46b8-af90-77f2288c3309 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:23.126638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b77ffa9c-a6e6-46b8-af90-77f2288c3309 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:23.128603 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:23.182621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b77ffa9c-a6e6-46b8-af90-77f2288c3309 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:23.189873 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b77ffa9c-a6e6-46b8-af90-77f2288c3309 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1094 microversion: 2.1 time: 0.067451 Jul 18 02:41:23.190807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 421/843] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:23 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:23.490598 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d85418ed-818e-43be-8e05-c2e1d7fe4cc0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:23.491503 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d85418ed-818e-43be-8e05-c2e1d7fe4cc0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:23.497865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d85418ed-818e-43be-8e05-c2e1d7fe4cc0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:23.498350 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d85418ed-818e-43be-8e05-c2e1d7fe4cc0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:23.499129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d85418ed-818e-43be-8e05-c2e1d7fe4cc0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:23.499569 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d85418ed-818e-43be-8e05-c2e1d7fe4cc0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:23.652640 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d85418ed-818e-43be-8e05-c2e1d7fe4cc0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:23.660744 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d85418ed-818e-43be-8e05-c2e1d7fe4cc0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:23.662228 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d85418ed-818e-43be-8e05-c2e1d7fe4cc0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:23.664411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d85418ed-818e-43be-8e05-c2e1d7fe4cc0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1723 microversion: 2.20 time: 0.177856 Jul 18 02:41:23.664965 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 422/844] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:23 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:41:23.686283 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d22e998d-9cbe-4632-a48c-1977ea35084b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28ede899-736a-431f-8dad-829aa4ed4a12"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:23.687390 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d22e998d-9cbe-4632-a48c-1977ea35084b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:23.693528 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d22e998d-9cbe-4632-a48c-1977ea35084b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:23.693979 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d22e998d-9cbe-4632-a48c-1977ea35084b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:23.694823 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d22e998d-9cbe-4632-a48c-1977ea35084b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:23.695260 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d22e998d-9cbe-4632-a48c-1977ea35084b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:23.964585 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d04cdd6a-58e8-4c87-a806-c22cbdf2d8c3 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.877192 Jul 18 02:41:23.965372 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 423/845] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:41:23 2022] POST /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:41:24.208676 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-456fac34-ad8c-4bee-94da-803d9267e16f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:24.209761 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-456fac34-ad8c-4bee-94da-803d9267e16f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:24.217579 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-456fac34-ad8c-4bee-94da-803d9267e16f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:24.218907 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-456fac34-ad8c-4bee-94da-803d9267e16f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:24.219451 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-456fac34-ad8c-4bee-94da-803d9267e16f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:24.219895 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-456fac34-ad8c-4bee-94da-803d9267e16f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:24.282504 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-456fac34-ad8c-4bee-94da-803d9267e16f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:24.290391 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-456fac34-ad8c-4bee-94da-803d9267e16f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1144 microversion: 2.1 time: 0.087260 Jul 18 02:41:24.290976 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 424/846] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:24 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:24.297058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-675a1b75-3a5d-4de1-b3ec-ce5d94a67b34 req-67d71ecd-113a-46ea-a169-fcefa13ee32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a", "name": "network-vif-unplugged", "status": "completed", "tag": "078d1890-a0ab-46d1-ac2c-464bd6da369c"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:24.309224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-675a1b75-3a5d-4de1-b3ec-ce5d94a67b34 req-67d71ecd-113a-46ea-a169-fcefa13ee32f service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:24.309224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-675a1b75-3a5d-4de1-b3ec-ce5d94a67b34 req-67d71ecd-113a-46ea-a169-fcefa13ee32f service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:24.317638 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.compute.server_external_events [req-675a1b75-3a5d-4de1-b3ec-ce5d94a67b34 req-67d71ecd-113a-46ea-a169-fcefa13ee32f service nova] Unable to find a host for instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a. Dropping event network-vif-unplugged {{(pid=124890) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 02:41:24.318545 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-675a1b75-3a5d-4de1-b3ec-ce5d94a67b34 req-67d71ecd-113a-46ea-a169-fcefa13ee32f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026648 Jul 18 02:41:24.319603 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 425/847] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 02:41:25.016214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d22e998d-9cbe-4632-a48c-1977ea35084b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "POST /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.334192 Jul 18 02:41:25.017277 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 423/848] 10.222.0.66 () {62 vars in 1363 bytes} [Mon Jul 18 02:41:23 2022] POST /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/os-volume_attachments => generated 188 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 02:41:25.136908 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d699df2b-f08e-4f2b-917b-a7f71b155450 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:25.137446 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d699df2b-f08e-4f2b-917b-a7f71b155450 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:25.143936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d699df2b-f08e-4f2b-917b-a7f71b155450 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.144386 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d699df2b-f08e-4f2b-917b-a7f71b155450 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.145143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d699df2b-f08e-4f2b-917b-a7f71b155450 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.145576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d699df2b-f08e-4f2b-917b-a7f71b155450 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.308208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bcc48f8a-b59d-4040-9446-e4147c5f9795 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:25.309166 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bcc48f8a-b59d-4040-9446-e4147c5f9795 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:25.316232 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bcc48f8a-b59d-4040-9446-e4147c5f9795 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.316644 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bcc48f8a-b59d-4040-9446-e4147c5f9795 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.317460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bcc48f8a-b59d-4040-9446-e4147c5f9795 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:25.317901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bcc48f8a-b59d-4040-9446-e4147c5f9795 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:25.381404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bcc48f8a-b59d-4040-9446-e4147c5f9795 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:25.388721 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bcc48f8a-b59d-4040-9446-e4147c5f9795 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1192 microversion: 2.1 time: 0.085074 Jul 18 02:41:25.389294 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 424/849] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:25 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:25.956825 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d699df2b-f08e-4f2b-917b-a7f71b155450 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/os-volume_attachments/28ede899-736a-431f-8dad-829aa4ed4a12" status: 202 len: 0 microversion: 2.20 time: 0.824298 Jul 18 02:41:25.960505 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 426/850] 10.222.0.66 () {60 vars in 1456 bytes} [Mon Jul 18 02:41:25 2022] DELETE /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/os-volume_attachments/28ede899-736a-431f-8dad-829aa4ed4a12 => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:41:26.028067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-549b508b-a96d-4267-a74b-39e4de929efb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:26.028067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-549b508b-a96d-4267-a74b-39e4de929efb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:26.028067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-549b508b-a96d-4267-a74b-39e4de929efb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.028067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-549b508b-a96d-4267-a74b-39e4de929efb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.028792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-549b508b-a96d-4267-a74b-39e4de929efb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.028792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-549b508b-a96d-4267-a74b-39e4de929efb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.305664 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-549b508b-a96d-4267-a74b-39e4de929efb tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "POST /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/action" status: 202 len: 0 microversion: 2.20 time: 0.292289 Jul 18 02:41:26.306478 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 425/851] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Jul 18 02:41:26 2022] POST /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:41:26.314961 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5816954d-adea-4a4d-839e-37da9e317159 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:26.315727 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-5816954d-adea-4a4d-839e-37da9e317159 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:26.324047 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5816954d-adea-4a4d-839e-37da9e317159 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.324513 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5816954d-adea-4a4d-839e-37da9e317159 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.326058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5816954d-adea-4a4d-839e-37da9e317159 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.326058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5816954d-adea-4a4d-839e-37da9e317159 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.404937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3caaabe8-4e39-4e8c-b193-3ea96a7b1973 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:26.405558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3caaabe8-4e39-4e8c-b193-3ea96a7b1973 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:26.413116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3caaabe8-4e39-4e8c-b193-3ea96a7b1973 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.413723 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3caaabe8-4e39-4e8c-b193-3ea96a7b1973 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.415225 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3caaabe8-4e39-4e8c-b193-3ea96a7b1973 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:26.415666 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3caaabe8-4e39-4e8c-b193-3ea96a7b1973 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:26.480204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5816954d-adea-4a4d-839e-37da9e317159 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:26.489761 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5816954d-adea-4a4d-839e-37da9e317159 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:26.491565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5816954d-adea-4a4d-839e-37da9e317159 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:26.493358 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5816954d-adea-4a4d-839e-37da9e317159 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1671 microversion: 2.20 time: 0.181721 Jul 18 02:41:26.494345 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 427/852] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:26 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1671 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:41:26.641805 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3caaabe8-4e39-4e8c-b193-3ea96a7b1973 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:26.650766 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3caaabe8-4e39-4e8c-b193-3ea96a7b1973 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.249734 Jul 18 02:41:26.651347 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 426/853] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:26 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:27.395224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-a7b38c6f-0201-4dd3-95b9-408cd3c1a549 req-3f1d0595-66df-4d10-8434-c257f5e59d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d47ffd3-9df5-400c-8cef-efcc7d6d97cd", "tag": "b0f73b8a-a342-4961-8be0-cc1c0a325389"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:27.406869 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-a7b38c6f-0201-4dd3-95b9-408cd3c1a549 req-3f1d0595-66df-4d10-8434-c257f5e59d25 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:27.407948 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-a7b38c6f-0201-4dd3-95b9-408cd3c1a549 req-3f1d0595-66df-4d10-8434-c257f5e59d25 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:27.420610 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-a7b38c6f-0201-4dd3-95b9-408cd3c1a549 req-3f1d0595-66df-4d10-8434-c257f5e59d25 service nova] Creating event network-changed:b0f73b8a-a342-4961-8be0-cc1c0a325389 for instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd on hv-cinder-85001 Jul 18 02:41:27.428630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-a7b38c6f-0201-4dd3-95b9-408cd3c1a549 req-3f1d0595-66df-4d10-8434-c257f5e59d25 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036974 Jul 18 02:41:27.429412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 428/854] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:27.512946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cf935659-e17b-47e8-bfd1-6b7f5fc94a04 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:27.513723 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-cf935659-e17b-47e8-bfd1-6b7f5fc94a04 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:27.524371 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cf935659-e17b-47e8-bfd1-6b7f5fc94a04 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:27.524837 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cf935659-e17b-47e8-bfd1-6b7f5fc94a04 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:27.525682 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cf935659-e17b-47e8-bfd1-6b7f5fc94a04 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:27.526165 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cf935659-e17b-47e8-bfd1-6b7f5fc94a04 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:27.668949 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cf92edde-d5fc-4686-914d-11fe3f5507dd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:27.669818 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cf92edde-d5fc-4686-914d-11fe3f5507dd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:27.676363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cf92edde-d5fc-4686-914d-11fe3f5507dd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:27.677071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cf92edde-d5fc-4686-914d-11fe3f5507dd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:27.678253 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cf92edde-d5fc-4686-914d-11fe3f5507dd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:27.678706 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cf92edde-d5fc-4686-914d-11fe3f5507dd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:27.699199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:27.770104 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-cf935659-e17b-47e8-bfd1-6b7f5fc94a04 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:27.778649 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-cf935659-e17b-47e8-bfd1-6b7f5fc94a04 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:27.780159 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-cf935659-e17b-47e8-bfd1-6b7f5fc94a04 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:27.781335 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-cf935659-e17b-47e8-bfd1-6b7f5fc94a04 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1671 microversion: 2.20 time: 0.273491 Jul 18 02:41:27.781906 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 427/855] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:27 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1671 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:27.825344 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cf92edde-d5fc-4686-914d-11fe3f5507dd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:27.840083 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cf92edde-d5fc-4686-914d-11fe3f5507dd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.175678 Jul 18 02:41:27.840677 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 429/856] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:27 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:28.800218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-00a3aedb-a900-453c-95e6-09904e4e862f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:28.800981 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-00a3aedb-a900-453c-95e6-09904e4e862f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:28.807726 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00a3aedb-a900-453c-95e6-09904e4e862f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:28.808213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00a3aedb-a900-453c-95e6-09904e4e862f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:28.809243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00a3aedb-a900-453c-95e6-09904e4e862f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:28.809682 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00a3aedb-a900-453c-95e6-09904e4e862f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:28.857210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-78f26d45-16e8-404a-a590-2d440dce6b1a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:28.858046 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-78f26d45-16e8-404a-a590-2d440dce6b1a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:28.865382 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-78f26d45-16e8-404a-a590-2d440dce6b1a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:28.865909 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-78f26d45-16e8-404a-a590-2d440dce6b1a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:28.866782 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-78f26d45-16e8-404a-a590-2d440dce6b1a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:28.867222 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-78f26d45-16e8-404a-a590-2d440dce6b1a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:28.951946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-00a3aedb-a900-453c-95e6-09904e4e862f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:28.960234 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-00a3aedb-a900-453c-95e6-09904e4e862f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:28.963218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-00a3aedb-a900-453c-95e6-09904e4e862f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:28.965223 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-00a3aedb-a900-453c-95e6-09904e4e862f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1673 microversion: 2.20 time: 0.168977 Jul 18 02:41:28.966284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 428/857] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:28 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:29.015373 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-78f26d45-16e8-404a-a590-2d440dce6b1a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:29.022746 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-78f26d45-16e8-404a-a590-2d440dce6b1a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.169367 Jul 18 02:41:29.023339 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 430/858] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:28 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:29.997048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-372a93db-2095-4612-b014-d747c65cbd63 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:29.997712 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-372a93db-2095-4612-b014-d747c65cbd63 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:30.004560 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-372a93db-2095-4612-b014-d747c65cbd63 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:30.005014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-372a93db-2095-4612-b014-d747c65cbd63 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:30.005783 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-372a93db-2095-4612-b014-d747c65cbd63 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:30.006288 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-372a93db-2095-4612-b014-d747c65cbd63 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:30.038730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f723d00b-9d8e-414e-af4b-0c8f0352c227 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:30.039500 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f723d00b-9d8e-414e-af4b-0c8f0352c227 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:30.047042 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f723d00b-9d8e-414e-af4b-0c8f0352c227 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:30.047798 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f723d00b-9d8e-414e-af4b-0c8f0352c227 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:30.048578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f723d00b-9d8e-414e-af4b-0c8f0352c227 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:30.049024 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f723d00b-9d8e-414e-af4b-0c8f0352c227 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:30.155199 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-372a93db-2095-4612-b014-d747c65cbd63 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:30.163252 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-372a93db-2095-4612-b014-d747c65cbd63 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:30.165453 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-372a93db-2095-4612-b014-d747c65cbd63 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:30.166781 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-372a93db-2095-4612-b014-d747c65cbd63 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.174086 Jul 18 02:41:30.170489 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 429/859] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:29 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:30.198383 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f723d00b-9d8e-414e-af4b-0c8f0352c227 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:30.205679 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f723d00b-9d8e-414e-af4b-0c8f0352c227 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.170734 Jul 18 02:41:30.206272 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 431/860] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:30 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:31.186724 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-58bffd08-2088-40a6-9fb1-90eaf428112e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:31.187567 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-58bffd08-2088-40a6-9fb1-90eaf428112e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:31.201253 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58bffd08-2088-40a6-9fb1-90eaf428112e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:31.201717 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58bffd08-2088-40a6-9fb1-90eaf428112e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:31.202552 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58bffd08-2088-40a6-9fb1-90eaf428112e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:31.203006 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58bffd08-2088-40a6-9fb1-90eaf428112e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:31.223709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f0a3673a-6e0a-4e69-8d64-31862ad14831 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:31.224442 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f0a3673a-6e0a-4e69-8d64-31862ad14831 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:31.232170 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f0a3673a-6e0a-4e69-8d64-31862ad14831 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:31.232524 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f0a3673a-6e0a-4e69-8d64-31862ad14831 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:31.233312 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f0a3673a-6e0a-4e69-8d64-31862ad14831 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:31.233743 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f0a3673a-6e0a-4e69-8d64-31862ad14831 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:31.410815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-58bffd08-2088-40a6-9fb1-90eaf428112e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:31.429406 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f0a3673a-6e0a-4e69-8d64-31862ad14831 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:31.430521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-58bffd08-2088-40a6-9fb1-90eaf428112e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:31.430630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f0a3673a-6e0a-4e69-8d64-31862ad14831 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.207868 Jul 18 02:41:31.430714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-58bffd08-2088-40a6-9fb1-90eaf428112e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:31.430979 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 432/861] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:31 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:31.431070 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-58bffd08-2088-40a6-9fb1-90eaf428112e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.247523 Jul 18 02:41:31.441020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 430/862] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:31 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:32.445423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-33624c98-8b5c-468a-b544-0af9cf1fc86a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:32.446182 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-33624c98-8b5c-468a-b544-0af9cf1fc86a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:32.448683 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a5cbc0a0-5d5d-4d65-9e36-f2e2def82717 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:32.449336 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a5cbc0a0-5d5d-4d65-9e36-f2e2def82717 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:32.452532 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-33624c98-8b5c-468a-b544-0af9cf1fc86a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.457065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-33624c98-8b5c-468a-b544-0af9cf1fc86a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.457065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-33624c98-8b5c-468a-b544-0af9cf1fc86a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.457065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-33624c98-8b5c-468a-b544-0af9cf1fc86a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.457355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a5cbc0a0-5d5d-4d65-9e36-f2e2def82717 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.457355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a5cbc0a0-5d5d-4d65-9e36-f2e2def82717 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.457542 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a5cbc0a0-5d5d-4d65-9e36-f2e2def82717 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:32.457913 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a5cbc0a0-5d5d-4d65-9e36-f2e2def82717 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:32.542269 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:32.656362 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a5cbc0a0-5d5d-4d65-9e36-f2e2def82717 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:32.669629 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a5cbc0a0-5d5d-4d65-9e36-f2e2def82717 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:32.671411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a5cbc0a0-5d5d-4d65-9e36-f2e2def82717 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:32.681195 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a5cbc0a0-5d5d-4d65-9e36-f2e2def82717 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.236496 Jul 18 02:41:32.683563 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 431/863] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:32 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:32.755983 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-33624c98-8b5c-468a-b544-0af9cf1fc86a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:32.764352 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-33624c98-8b5c-468a-b544-0af9cf1fc86a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.323586 Jul 18 02:41:32.764937 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 433/864] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:32 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:33.700769 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bc0d8ccd-e763-4e7b-bab7-b446aad9d4b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:33.701385 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bc0d8ccd-e763-4e7b-bab7-b446aad9d4b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:33.703289 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=8 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:33.708723 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bc0d8ccd-e763-4e7b-bab7-b446aad9d4b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:33.709261 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bc0d8ccd-e763-4e7b-bab7-b446aad9d4b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:33.710040 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bc0d8ccd-e763-4e7b-bab7-b446aad9d4b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:33.710712 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bc0d8ccd-e763-4e7b-bab7-b446aad9d4b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:33.714492 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:33.784932 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0ec05e28-d55f-4f64-a19b-6cf6a2ee219b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:33.787313 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0ec05e28-d55f-4f64-a19b-6cf6a2ee219b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:33.803644 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0ec05e28-d55f-4f64-a19b-6cf6a2ee219b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:33.804589 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0ec05e28-d55f-4f64-a19b-6cf6a2ee219b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:33.806526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0ec05e28-d55f-4f64-a19b-6cf6a2ee219b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:33.806960 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0ec05e28-d55f-4f64-a19b-6cf6a2ee219b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:33.892926 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bc0d8ccd-e763-4e7b-bab7-b446aad9d4b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:33.909404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bc0d8ccd-e763-4e7b-bab7-b446aad9d4b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:33.910946 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bc0d8ccd-e763-4e7b-bab7-b446aad9d4b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:33.912312 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bc0d8ccd-e763-4e7b-bab7-b446aad9d4b0 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.215682 Jul 18 02:41:33.913397 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 432/865] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:33 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:33.974218 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0ec05e28-d55f-4f64-a19b-6cf6a2ee219b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:33.982387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0ec05e28-d55f-4f64-a19b-6cf6a2ee219b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.204786 Jul 18 02:41:33.982963 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 434/866] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:33 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:34.949608 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c7e7b9b4-a968-4764-a1a7-0e635b75e8a2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:34.951486 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c7e7b9b4-a968-4764-a1a7-0e635b75e8a2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:34.961358 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c7e7b9b4-a968-4764-a1a7-0e635b75e8a2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:34.962366 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c7e7b9b4-a968-4764-a1a7-0e635b75e8a2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:34.963786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c7e7b9b4-a968-4764-a1a7-0e635b75e8a2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:34.964231 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c7e7b9b4-a968-4764-a1a7-0e635b75e8a2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:34.999272 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c469ed45-4b9a-4cb1-b89c-630dc939b65e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:35.000027 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c469ed45-4b9a-4cb1-b89c-630dc939b65e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:35.006427 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c469ed45-4b9a-4cb1-b89c-630dc939b65e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:35.006943 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c469ed45-4b9a-4cb1-b89c-630dc939b65e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:35.007719 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c469ed45-4b9a-4cb1-b89c-630dc939b65e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:35.010792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c469ed45-4b9a-4cb1-b89c-630dc939b65e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:35.117795 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c7e7b9b4-a968-4764-a1a7-0e635b75e8a2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:35.141810 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c7e7b9b4-a968-4764-a1a7-0e635b75e8a2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:35.147975 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c7e7b9b4-a968-4764-a1a7-0e635b75e8a2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:35.149195 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c7e7b9b4-a968-4764-a1a7-0e635b75e8a2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.205745 Jul 18 02:41:35.150182 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 433/867] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:34 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:35.177927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c469ed45-4b9a-4cb1-b89c-630dc939b65e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:35.186328 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c469ed45-4b9a-4cb1-b89c-630dc939b65e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.190908 Jul 18 02:41:35.187557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 435/868] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:34 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:36.096146 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6cfb6bd4-a792-4935-93c5-311af34bba35 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:36.096772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6cfb6bd4-a792-4935-93c5-311af34bba35 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:36.103052 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6cfb6bd4-a792-4935-93c5-311af34bba35 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:36.103509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6cfb6bd4-a792-4935-93c5-311af34bba35 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:36.104987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6cfb6bd4-a792-4935-93c5-311af34bba35 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:36.105429 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6cfb6bd4-a792-4935-93c5-311af34bba35 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:36.130702 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6cfb6bd4-a792-4935-93c5-311af34bba35 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/ips" status: 200 len: 150 microversion: 2.1 time: 0.038465 Jul 18 02:41:36.137026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 434/869] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Jul 18 02:41:36 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:36.169968 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-63e021ab-d0b9-43db-bf72-49d63093025c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:36.171246 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-63e021ab-d0b9-43db-bf72-49d63093025c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:36.180716 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-63e021ab-d0b9-43db-bf72-49d63093025c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:36.181290 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-63e021ab-d0b9-43db-bf72-49d63093025c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:36.182772 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-63e021ab-d0b9-43db-bf72-49d63093025c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:36.183212 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-63e021ab-d0b9-43db-bf72-49d63093025c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:36.205074 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2f11c33d-ec08-4e24-9b60-0b553e585c0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:36.205700 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2f11c33d-ec08-4e24-9b60-0b553e585c0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:36.211805 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2f11c33d-ec08-4e24-9b60-0b553e585c0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:36.212251 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2f11c33d-ec08-4e24-9b60-0b553e585c0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:36.213141 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2f11c33d-ec08-4e24-9b60-0b553e585c0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:36.213678 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2f11c33d-ec08-4e24-9b60-0b553e585c0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:36.328960 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-63e021ab-d0b9-43db-bf72-49d63093025c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:36.341580 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-63e021ab-d0b9-43db-bf72-49d63093025c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:36.344872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-63e021ab-d0b9-43db-bf72-49d63093025c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:36.347128 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-63e021ab-d0b9-43db-bf72-49d63093025c tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.182570 Jul 18 02:41:36.348286 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 436/870] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:36 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:36.367672 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-2f11c33d-ec08-4e24-9b60-0b553e585c0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:36.375608 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2f11c33d-ec08-4e24-9b60-0b553e585c0e tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.175138 Jul 18 02:41:36.376375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 435/871] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:36 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:37.366402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d8ad76d7-16aa-463c-9b68-7e2516a1389b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:37.367414 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d8ad76d7-16aa-463c-9b68-7e2516a1389b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:37.374696 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8ad76d7-16aa-463c-9b68-7e2516a1389b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:37.375151 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8ad76d7-16aa-463c-9b68-7e2516a1389b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:37.375936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8ad76d7-16aa-463c-9b68-7e2516a1389b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:37.376377 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8ad76d7-16aa-463c-9b68-7e2516a1389b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:37.393094 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fe0d69c2-c13b-4807-b8e7-9305828e12c4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:37.393772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fe0d69c2-c13b-4807-b8e7-9305828e12c4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:37.399992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fe0d69c2-c13b-4807-b8e7-9305828e12c4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:37.401173 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fe0d69c2-c13b-4807-b8e7-9305828e12c4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:37.402222 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fe0d69c2-c13b-4807-b8e7-9305828e12c4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:37.402735 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fe0d69c2-c13b-4807-b8e7-9305828e12c4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:37.521764 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d8ad76d7-16aa-463c-9b68-7e2516a1389b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:37.532449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d8ad76d7-16aa-463c-9b68-7e2516a1389b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:37.534398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d8ad76d7-16aa-463c-9b68-7e2516a1389b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:37.536004 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d8ad76d7-16aa-463c-9b68-7e2516a1389b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.173576 Jul 18 02:41:37.560548 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 437/872] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:37 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:37.569607 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fe0d69c2-c13b-4807-b8e7-9305828e12c4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:37.589421 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fe0d69c2-c13b-4807-b8e7-9305828e12c4 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.200336 Jul 18 02:41:37.590016 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 436/873] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:37 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:38.554784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-76a6e14b-7ac7-4692-a00f-82056f2fbc86 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:38.556234 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-76a6e14b-7ac7-4692-a00f-82056f2fbc86 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:38.564221 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-76a6e14b-7ac7-4692-a00f-82056f2fbc86 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:38.565372 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-76a6e14b-7ac7-4692-a00f-82056f2fbc86 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:38.566845 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-76a6e14b-7ac7-4692-a00f-82056f2fbc86 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:38.567681 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-76a6e14b-7ac7-4692-a00f-82056f2fbc86 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:38.608395 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bf7bc3f0-7b04-45f4-95f5-8b6d4c72e56c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:38.609172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bf7bc3f0-7b04-45f4-95f5-8b6d4c72e56c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:38.620243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bf7bc3f0-7b04-45f4-95f5-8b6d4c72e56c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:38.621347 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bf7bc3f0-7b04-45f4-95f5-8b6d4c72e56c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:38.622193 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bf7bc3f0-7b04-45f4-95f5-8b6d4c72e56c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:38.622635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bf7bc3f0-7b04-45f4-95f5-8b6d4c72e56c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:38.774269 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-76a6e14b-7ac7-4692-a00f-82056f2fbc86 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:38.774269 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-76a6e14b-7ac7-4692-a00f-82056f2fbc86 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:38.774589 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-76a6e14b-7ac7-4692-a00f-82056f2fbc86 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:38.774589 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-76a6e14b-7ac7-4692-a00f-82056f2fbc86 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.191034 Jul 18 02:41:38.774589 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 438/874] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:38 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:38.790064 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bf7bc3f0-7b04-45f4-95f5-8b6d4c72e56c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:38.808572 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bf7bc3f0-7b04-45f4-95f5-8b6d4c72e56c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.204313 Jul 18 02:41:38.817162 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 437/875] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:38 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:39.798960 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b31adec3-43d7-47e0-a9e1-f7e3253d2b2b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:39.800164 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b31adec3-43d7-47e0-a9e1-f7e3253d2b2b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:39.807537 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b31adec3-43d7-47e0-a9e1-f7e3253d2b2b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:39.808319 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b31adec3-43d7-47e0-a9e1-f7e3253d2b2b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:39.809595 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b31adec3-43d7-47e0-a9e1-f7e3253d2b2b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:39.810306 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b31adec3-43d7-47e0-a9e1-f7e3253d2b2b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:39.831525 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d099bb95-02ef-4f3e-969c-e08f566fe5d3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:39.832870 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d099bb95-02ef-4f3e-969c-e08f566fe5d3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:39.840664 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d099bb95-02ef-4f3e-969c-e08f566fe5d3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:39.843693 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d099bb95-02ef-4f3e-969c-e08f566fe5d3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:39.843693 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d099bb95-02ef-4f3e-969c-e08f566fe5d3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:39.843997 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d099bb95-02ef-4f3e-969c-e08f566fe5d3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:39.968853 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b31adec3-43d7-47e0-a9e1-f7e3253d2b2b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:39.981218 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b31adec3-43d7-47e0-a9e1-f7e3253d2b2b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:39.983094 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b31adec3-43d7-47e0-a9e1-f7e3253d2b2b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:39.984345 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b31adec3-43d7-47e0-a9e1-f7e3253d2b2b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.189359 Jul 18 02:41:39.994201 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 439/876] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:39 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:39.994201 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-59b8fe20-3b8f-4bc8-9e68-21ada944c552 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad7db13e-4f14-47bc-b4aa-99afd1b313bb"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:39.994201 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-59b8fe20-3b8f-4bc8-9e68-21ada944c552 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:39.998768 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-59b8fe20-3b8f-4bc8-9e68-21ada944c552 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:39.999291 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-59b8fe20-3b8f-4bc8-9e68-21ada944c552 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:40.000144 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-59b8fe20-3b8f-4bc8-9e68-21ada944c552 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:40.000685 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-59b8fe20-3b8f-4bc8-9e68-21ada944c552 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:40.024918 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d099bb95-02ef-4f3e-969c-e08f566fe5d3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:40.035392 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d099bb95-02ef-4f3e-969c-e08f566fe5d3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.207533 Jul 18 02:41:40.037500 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 438/877] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:39 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:41.004399 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-688d654a-4953-444d-853c-26c3c54f8c22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:41.005132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-688d654a-4953-444d-853c-26c3c54f8c22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:41.011936 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-688d654a-4953-444d-853c-26c3c54f8c22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:41.012377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-688d654a-4953-444d-853c-26c3c54f8c22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:41.013132 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-688d654a-4953-444d-853c-26c3c54f8c22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:41.013561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-688d654a-4953-444d-853c-26c3c54f8c22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:41.147703 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-688d654a-4953-444d-853c-26c3c54f8c22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:41.156309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-688d654a-4953-444d-853c-26c3c54f8c22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:41.157815 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-688d654a-4953-444d-853c-26c3c54f8c22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:41.159002 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-688d654a-4953-444d-853c-26c3c54f8c22 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.158618 Jul 18 02:41:41.159561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 439/878] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:40 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:41:41.163991 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c1d1be09-bfd2-4cf0-b99d-831b33d4e9f8 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:41.164592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c1d1be09-bfd2-4cf0-b99d-831b33d4e9f8 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:41.170704 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1d1be09-bfd2-4cf0-b99d-831b33d4e9f8 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:41.171144 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1d1be09-bfd2-4cf0-b99d-831b33d4e9f8 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:41.171912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1d1be09-bfd2-4cf0-b99d-831b33d4e9f8 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:41.172354 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1d1be09-bfd2-4cf0-b99d-831b33d4e9f8 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:41.300690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c1d1be09-bfd2-4cf0-b99d-831b33d4e9f8 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:41.308669 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c1d1be09-bfd2-4cf0-b99d-831b33d4e9f8 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.148165 Jul 18 02:41:41.309487 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 440/879] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:41 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:42.176774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0aaefcd9-f278-420e-8f50-4757cbd1b285 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:42.177351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0aaefcd9-f278-420e-8f50-4757cbd1b285 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:42.184899 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0aaefcd9-f278-420e-8f50-4757cbd1b285 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:42.185344 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0aaefcd9-f278-420e-8f50-4757cbd1b285 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:42.186218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0aaefcd9-f278-420e-8f50-4757cbd1b285 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:42.186699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0aaefcd9-f278-420e-8f50-4757cbd1b285 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:42.319281 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0aaefcd9-f278-420e-8f50-4757cbd1b285 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:42.328031 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0aaefcd9-f278-420e-8f50-4757cbd1b285 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:42.329577 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0aaefcd9-f278-420e-8f50-4757cbd1b285 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:42.330744 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0aaefcd9-f278-420e-8f50-4757cbd1b285 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.157992 Jul 18 02:41:42.340116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 441/880] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:42 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:41:42.340116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-24715411-d982-4f48-8656-d9f165859aee tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:42.340116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-24715411-d982-4f48-8656-d9f165859aee tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:42.342293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24715411-d982-4f48-8656-d9f165859aee tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:42.342738 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24715411-d982-4f48-8656-d9f165859aee tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:42.343487 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24715411-d982-4f48-8656-d9f165859aee tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:42.343914 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24715411-d982-4f48-8656-d9f165859aee tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:42.477199 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-24715411-d982-4f48-8656-d9f165859aee tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:42.484636 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-24715411-d982-4f48-8656-d9f165859aee tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.152434 Jul 18 02:41:42.485197 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 442/881] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:42 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:43.349247 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0481746d-4e11-4191-b2c7-d30240e00743 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:43.349921 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0481746d-4e11-4191-b2c7-d30240e00743 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:43.357151 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0481746d-4e11-4191-b2c7-d30240e00743 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:43.357546 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0481746d-4e11-4191-b2c7-d30240e00743 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:43.358375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0481746d-4e11-4191-b2c7-d30240e00743 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:43.358833 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0481746d-4e11-4191-b2c7-d30240e00743 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:43.497401 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0481746d-4e11-4191-b2c7-d30240e00743 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:43.505578 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0481746d-4e11-4191-b2c7-d30240e00743 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:43.507175 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0481746d-4e11-4191-b2c7-d30240e00743 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:43.512526 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0481746d-4e11-4191-b2c7-d30240e00743 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.163072 Jul 18 02:41:43.512526 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 443/882] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:43 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:43.513929 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4bf7c600-fcd1-40d9-8563-10ce2b4545fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:43.514659 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4bf7c600-fcd1-40d9-8563-10ce2b4545fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:43.520493 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4bf7c600-fcd1-40d9-8563-10ce2b4545fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:43.521009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4bf7c600-fcd1-40d9-8563-10ce2b4545fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:43.521773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4bf7c600-fcd1-40d9-8563-10ce2b4545fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:43.522242 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4bf7c600-fcd1-40d9-8563-10ce2b4545fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:43.661731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4bf7c600-fcd1-40d9-8563-10ce2b4545fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:43.670259 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4bf7c600-fcd1-40d9-8563-10ce2b4545fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.160363 Jul 18 02:41:43.670866 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 444/883] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:43 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:43.741308 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-59b8fe20-3b8f-4bc8-9e68-21ada944c552 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "POST /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.754833 Jul 18 02:41:43.741959 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 440/884] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:41:39 2022] POST /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 194 bytes in 3756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:44.365671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-30e703db-9cc3-4984-a80b-b302d6532fbb tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:44.365671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-30e703db-9cc3-4984-a80b-b302d6532fbb tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:44.370754 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30e703db-9cc3-4984-a80b-b302d6532fbb tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.371381 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30e703db-9cc3-4984-a80b-b302d6532fbb tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.372048 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30e703db-9cc3-4984-a80b-b302d6532fbb tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.372468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-30e703db-9cc3-4984-a80b-b302d6532fbb tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.408546 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-30e703db-9cc3-4984-a80b-b302d6532fbb tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050185 Jul 18 02:41:44.408826 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 445/885] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:41:44 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:44.420282 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-69ae3f93-310d-4818-a5ba-04b033e7bb36 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:44.422818 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-69ae3f93-310d-4818-a5ba-04b033e7bb36 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:44.427137 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69ae3f93-310d-4818-a5ba-04b033e7bb36 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.427592 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69ae3f93-310d-4818-a5ba-04b033e7bb36 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.428391 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69ae3f93-310d-4818-a5ba-04b033e7bb36 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.428833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69ae3f93-310d-4818-a5ba-04b033e7bb36 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.459530 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-69ae3f93-310d-4818-a5ba-04b033e7bb36 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments/ac671bbd-431f-4b08-8664-846a41169628" status: 200 len: 194 microversion: 2.1 time: 0.044080 Jul 18 02:41:44.460115 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 441/886] 10.222.0.66 () {58 vars in 1412 bytes} [Mon Jul 18 02:41:44 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments/ac671bbd-431f-4b08-8664-846a41169628 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:44.526240 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5e78d738-cced-44c9-ac16-533ce67b148e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:44.527417 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5e78d738-cced-44c9-ac16-533ce67b148e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:44.533600 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5e78d738-cced-44c9-ac16-533ce67b148e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.534208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5e78d738-cced-44c9-ac16-533ce67b148e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.534850 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5e78d738-cced-44c9-ac16-533ce67b148e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.535290 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5e78d738-cced-44c9-ac16-533ce67b148e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.674387 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5e78d738-cced-44c9-ac16-533ce67b148e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:44.688174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8b65040c-fbb4-48a9-b705-b04be4c8228c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:44.688791 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8b65040c-fbb4-48a9-b705-b04be4c8228c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:44.689794 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5e78d738-cced-44c9-ac16-533ce67b148e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:44.695164 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8b65040c-fbb4-48a9-b705-b04be4c8228c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.695830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8b65040c-fbb4-48a9-b705-b04be4c8228c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.696769 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8b65040c-fbb4-48a9-b705-b04be4c8228c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:44.697393 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8b65040c-fbb4-48a9-b705-b04be4c8228c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:44.703967 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5e78d738-cced-44c9-ac16-533ce67b148e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:44.705533 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5e78d738-cced-44c9-ac16-533ce67b148e tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.183211 Jul 18 02:41:44.706315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 446/887] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:44 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:44.837134 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8b65040c-fbb4-48a9-b705-b04be4c8228c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:44.845870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8b65040c-fbb4-48a9-b705-b04be4c8228c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1278 microversion: 2.1 time: 0.161820 Jul 18 02:41:44.846424 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 442/888] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:44 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:45.724389 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-65913fe6-36a7-4bdc-81d8-cf56bfe08e11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:45.725001 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-65913fe6-36a7-4bdc-81d8-cf56bfe08e11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:45.731591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65913fe6-36a7-4bdc-81d8-cf56bfe08e11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:45.732045 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65913fe6-36a7-4bdc-81d8-cf56bfe08e11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:45.732845 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65913fe6-36a7-4bdc-81d8-cf56bfe08e11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:45.733284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65913fe6-36a7-4bdc-81d8-cf56bfe08e11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:45.863026 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9b6426da-e2e1-449c-abb0-6b330056c952 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:45.863638 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9b6426da-e2e1-449c-abb0-6b330056c952 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:45.866704 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=58 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:45.873410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-65913fe6-36a7-4bdc-81d8-cf56bfe08e11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:45.873620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b6426da-e2e1-449c-abb0-6b330056c952 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:45.873866 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b6426da-e2e1-449c-abb0-6b330056c952 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:45.874887 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b6426da-e2e1-449c-abb0-6b330056c952 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:45.875545 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b6426da-e2e1-449c-abb0-6b330056c952 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:45.881957 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-65913fe6-36a7-4bdc-81d8-cf56bfe08e11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:45.889912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-65913fe6-36a7-4bdc-81d8-cf56bfe08e11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:45.889912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-65913fe6-36a7-4bdc-81d8-cf56bfe08e11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.164335 Jul 18 02:41:45.889912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 447/889] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:45 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:46.023534 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9b6426da-e2e1-449c-abb0-6b330056c952 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:46.031759 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9b6426da-e2e1-449c-abb0-6b330056c952 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.172632 Jul 18 02:41:46.032321 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 443/890] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:45 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:46.117452 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bd9f55cc-f454-4b0e-ab58-acabb404fc07 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52535eaa-148a-43b7-baab-ebfbea1b6014"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:46.118865 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bd9f55cc-f454-4b0e-ab58-acabb404fc07 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:46.133620 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd9f55cc-f454-4b0e-ab58-acabb404fc07 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:46.134189 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd9f55cc-f454-4b0e-ab58-acabb404fc07 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:46.135096 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd9f55cc-f454-4b0e-ab58-acabb404fc07 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:46.135614 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd9f55cc-f454-4b0e-ab58-acabb404fc07 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:46.279768 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-c5e9df9a-93fa-421f-8398-c8903425be77 req-7fab98ca-c21a-49b2-b15b-aa31a4125ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a", "name": "network-vif-plugged", "status": "completed", "tag": "078d1890-a0ab-46d1-ac2c-464bd6da369c"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:46.288016 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-c5e9df9a-93fa-421f-8398-c8903425be77 req-7fab98ca-c21a-49b2-b15b-aa31a4125ebd service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:46.288834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-c5e9df9a-93fa-421f-8398-c8903425be77 req-7fab98ca-c21a-49b2-b15b-aa31a4125ebd service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:46.299239 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-c5e9df9a-93fa-421f-8398-c8903425be77 req-7fab98ca-c21a-49b2-b15b-aa31a4125ebd service nova] Creating event network-vif-plugged:078d1890-a0ab-46d1-ac2c-464bd6da369c for instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a on hv-cinder-85001 Jul 18 02:41:46.304103 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-c5e9df9a-93fa-421f-8398-c8903425be77 req-7fab98ca-c21a-49b2-b15b-aa31a4125ebd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028638 Jul 18 02:41:46.304622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 444/891] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:41:46.391659 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:46.904290 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e153c44b-5094-4873-8d30-168999640c3b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:46.904979 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e153c44b-5094-4873-8d30-168999640c3b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:46.911152 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e153c44b-5094-4873-8d30-168999640c3b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:46.911605 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e153c44b-5094-4873-8d30-168999640c3b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:46.912365 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e153c44b-5094-4873-8d30-168999640c3b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:46.912804 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e153c44b-5094-4873-8d30-168999640c3b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:46.915434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:47.054687 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e153c44b-5094-4873-8d30-168999640c3b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:47.063541 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e153c44b-5094-4873-8d30-168999640c3b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:47.065040 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e153c44b-5094-4873-8d30-168999640c3b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:47.066227 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e153c44b-5094-4873-8d30-168999640c3b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.166650 Jul 18 02:41:47.068425 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 445/892] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:46 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:41:47.073438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c8122566-11c6-4adc-b621-c5009c44ade9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:47.074042 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c8122566-11c6-4adc-b621-c5009c44ade9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:47.079830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8122566-11c6-4adc-b621-c5009c44ade9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:47.080373 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8122566-11c6-4adc-b621-c5009c44ade9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:47.081133 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8122566-11c6-4adc-b621-c5009c44ade9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:47.081565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c8122566-11c6-4adc-b621-c5009c44ade9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:47.107818 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bd9f55cc-f454-4b0e-ab58-acabb404fc07 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "POST /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.994106 Jul 18 02:41:47.109010 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 448/893] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:41:46 2022] POST /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments => generated 194 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:41:47.223070 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c8122566-11c6-4adc-b621-c5009c44ade9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:47.230884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c8122566-11c6-4adc-b621-c5009c44ade9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.161432 Jul 18 02:41:47.231385 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 446/894] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:47 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:48.086806 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9564bf25-654f-4712-b557-02ebcf531172 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:48.087531 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9564bf25-654f-4712-b557-02ebcf531172 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:48.094752 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9564bf25-654f-4712-b557-02ebcf531172 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:48.095213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9564bf25-654f-4712-b557-02ebcf531172 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:48.095990 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9564bf25-654f-4712-b557-02ebcf531172 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:48.096430 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9564bf25-654f-4712-b557-02ebcf531172 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:48.236590 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-9564bf25-654f-4712-b557-02ebcf531172 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:48.246020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-9564bf25-654f-4712-b557-02ebcf531172 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:48.248460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-9564bf25-654f-4712-b557-02ebcf531172 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:48.249023 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-027a905d-599b-454f-9f44-7e921b1e7abd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:48.249640 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-027a905d-599b-454f-9f44-7e921b1e7abd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:48.249773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9564bf25-654f-4712-b557-02ebcf531172 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.167222 Jul 18 02:41:48.250246 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 449/895] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:48 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 02:41:48.257340 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-027a905d-599b-454f-9f44-7e921b1e7abd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:48.258286 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-027a905d-599b-454f-9f44-7e921b1e7abd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:48.258590 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-027a905d-599b-454f-9f44-7e921b1e7abd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:48.259010 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-027a905d-599b-454f-9f44-7e921b1e7abd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:48.396608 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-027a905d-599b-454f-9f44-7e921b1e7abd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:48.405427 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-027a905d-599b-454f-9f44-7e921b1e7abd tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.161579 Jul 18 02:41:48.405830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 447/896] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:48 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:49.269991 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-31b49e52-b905-48e7-81a5-f673fa64f1c5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:49.270647 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-31b49e52-b905-48e7-81a5-f673fa64f1c5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:49.277534 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-31b49e52-b905-48e7-81a5-f673fa64f1c5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:49.278102 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-31b49e52-b905-48e7-81a5-f673fa64f1c5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:49.278884 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-31b49e52-b905-48e7-81a5-f673fa64f1c5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:49.279330 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-31b49e52-b905-48e7-81a5-f673fa64f1c5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:49.411896 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-31b49e52-b905-48e7-81a5-f673fa64f1c5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:49.420451 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-31b49e52-b905-48e7-81a5-f673fa64f1c5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:49.421969 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-31b49e52-b905-48e7-81a5-f673fa64f1c5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:49.423178 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-31b49e52-b905-48e7-81a5-f673fa64f1c5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1729 microversion: 2.20 time: 0.158476 Jul 18 02:41:49.423323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8a4f72f9-7c0a-4c07-ad1d-2188b9550e5f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:49.423792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8a4f72f9-7c0a-4c07-ad1d-2188b9550e5f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:49.424592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 450/897] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:49 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:49.430542 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a4f72f9-7c0a-4c07-ad1d-2188b9550e5f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:49.431182 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a4f72f9-7c0a-4c07-ad1d-2188b9550e5f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:49.432583 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a4f72f9-7c0a-4c07-ad1d-2188b9550e5f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:49.433429 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a4f72f9-7c0a-4c07-ad1d-2188b9550e5f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:49.565937 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8a4f72f9-7c0a-4c07-ad1d-2188b9550e5f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:49.573418 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8a4f72f9-7c0a-4c07-ad1d-2188b9550e5f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.154082 Jul 18 02:41:49.573974 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 448/898] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:49 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:41:50.443899 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c1b69c2b-d1c1-477f-a78c-82a76f5f36e2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:50.444502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c1b69c2b-d1c1-477f-a78c-82a76f5f36e2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:50.451728 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1b69c2b-d1c1-477f-a78c-82a76f5f36e2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:50.452163 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1b69c2b-d1c1-477f-a78c-82a76f5f36e2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:50.452929 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1b69c2b-d1c1-477f-a78c-82a76f5f36e2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:50.453363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1b69c2b-d1c1-477f-a78c-82a76f5f36e2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:50.580908 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c1b69c2b-d1c1-477f-a78c-82a76f5f36e2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:50.589274 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c1b69c2b-d1c1-477f-a78c-82a76f5f36e2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:50.590528 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5ac55a84-4edc-4023-a869-12518cc16bb3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:50.591052 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c1b69c2b-d1c1-477f-a78c-82a76f5f36e2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:50.591171 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-5ac55a84-4edc-4023-a869-12518cc16bb3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:50.592029 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c1b69c2b-d1c1-477f-a78c-82a76f5f36e2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1716 microversion: 2.20 time: 0.152350 Jul 18 02:41:50.592682 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 451/899] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:41:50 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:41:50.597084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5ac55a84-4edc-4023-a869-12518cc16bb3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:50.597538 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5ac55a84-4edc-4023-a869-12518cc16bb3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:50.598412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5ac55a84-4edc-4023-a869-12518cc16bb3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:50.598851 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5ac55a84-4edc-4023-a869-12518cc16bb3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:50.735102 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5ac55a84-4edc-4023-a869-12518cc16bb3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:50.742707 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5ac55a84-4edc-4023-a869-12518cc16bb3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.156537 Jul 18 02:41:50.743287 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 449/900] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:50 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:51.760809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3ccae4bc-8750-4eaa-9bee-79949c606e81 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:51.761561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3ccae4bc-8750-4eaa-9bee-79949c606e81 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:51.768174 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ccae4bc-8750-4eaa-9bee-79949c606e81 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:51.768629 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ccae4bc-8750-4eaa-9bee-79949c606e81 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:51.769423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ccae4bc-8750-4eaa-9bee-79949c606e81 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:51.769861 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ccae4bc-8750-4eaa-9bee-79949c606e81 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:51.905296 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3ccae4bc-8750-4eaa-9bee-79949c606e81 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:51.912845 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3ccae4bc-8750-4eaa-9bee-79949c606e81 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.156626 Jul 18 02:41:51.913702 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 452/901] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:51 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:52.903533 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-04ff91aa-f41e-4173-9858-3a87f60ad797 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:52.904093 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-04ff91aa-f41e-4173-9858-3a87f60ad797 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:52.910630 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04ff91aa-f41e-4173-9858-3a87f60ad797 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:52.911082 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04ff91aa-f41e-4173-9858-3a87f60ad797 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:52.911854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04ff91aa-f41e-4173-9858-3a87f60ad797 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:52.912287 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-04ff91aa-f41e-4173-9858-3a87f60ad797 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:52.929748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-93ab324c-d709-4bf4-af82-297d12568dea tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:52.930559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-93ab324c-d709-4bf4-af82-297d12568dea tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:52.937387 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93ab324c-d709-4bf4-af82-297d12568dea tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:52.937927 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93ab324c-d709-4bf4-af82-297d12568dea tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:52.938825 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93ab324c-d709-4bf4-af82-297d12568dea tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:52.939343 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93ab324c-d709-4bf4-af82-297d12568dea tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:52.996912 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-04ff91aa-f41e-4173-9858-3a87f60ad797 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lazy-loading 'services' on Instance uuid 85324481-a04a-4d16-b72d-6a355b0775d0 {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:41:53.080561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-93ab324c-d709-4bf4-af82-297d12568dea tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:53.087954 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-93ab324c-d709-4bf4-af82-297d12568dea tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.162189 Jul 18 02:41:53.089116 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 453/902] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:52 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:53.243797 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-04ff91aa-f41e-4173-9858-3a87f60ad797 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments/ad7db13e-4f14-47bc-b4aa-99afd1b313bb" status: 202 len: 0 microversion: 2.1 time: 0.344489 Jul 18 02:41:53.244393 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 450/903] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:41:52 2022] DELETE /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments/ad7db13e-4f14-47bc-b4aa-99afd1b313bb => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:41:53.252821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2ec50e25-fc63-48e1-99a0-9a12afe0e267 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:53.253814 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2ec50e25-fc63-48e1-99a0-9a12afe0e267 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:53.259825 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2ec50e25-fc63-48e1-99a0-9a12afe0e267 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.261091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2ec50e25-fc63-48e1-99a0-9a12afe0e267 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.262040 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2ec50e25-fc63-48e1-99a0-9a12afe0e267 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:53.262520 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2ec50e25-fc63-48e1-99a0-9a12afe0e267 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:53.291937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2ec50e25-fc63-48e1-99a0-9a12afe0e267 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043018 Jul 18 02:41:53.292497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 454/904] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:41:53 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:54.106327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bbefe0ad-2e84-424d-b6e3-f9a363e4bbfb tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:54.106956 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bbefe0ad-2e84-424d-b6e3-f9a363e4bbfb tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:54.113842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bbefe0ad-2e84-424d-b6e3-f9a363e4bbfb tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.114327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bbefe0ad-2e84-424d-b6e3-f9a363e4bbfb tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.115105 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bbefe0ad-2e84-424d-b6e3-f9a363e4bbfb tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.115546 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bbefe0ad-2e84-424d-b6e3-f9a363e4bbfb tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.243755 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-bbefe0ad-2e84-424d-b6e3-f9a363e4bbfb tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:54.251134 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bbefe0ad-2e84-424d-b6e3-f9a363e4bbfb tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.150101 Jul 18 02:41:54.251701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 451/905] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:54 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:54.303683 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5dff4793-f1a1-4922-a08f-b46e93b3e437 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:54.304606 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5dff4793-f1a1-4922-a08f-b46e93b3e437 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:54.307110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=72 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:54.312197 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5dff4793-f1a1-4922-a08f-b46e93b3e437 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.312654 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5dff4793-f1a1-4922-a08f-b46e93b3e437 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.313410 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5dff4793-f1a1-4922-a08f-b46e93b3e437 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:54.313848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5dff4793-f1a1-4922-a08f-b46e93b3e437 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:54.342935 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5dff4793-f1a1-4922-a08f-b46e93b3e437 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043088 Jul 18 02:41:54.343487 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 455/906] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:41:54 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:55.268413 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6bf3ac2d-8e9b-440a-ad97-d10a1e554a8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:55.269014 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6bf3ac2d-8e9b-440a-ad97-d10a1e554a8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:55.275702 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bf3ac2d-8e9b-440a-ad97-d10a1e554a8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.276124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bf3ac2d-8e9b-440a-ad97-d10a1e554a8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.276894 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bf3ac2d-8e9b-440a-ad97-d10a1e554a8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.277900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bf3ac2d-8e9b-440a-ad97-d10a1e554a8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.354636 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0cf9a467-0ceb-424f-a66a-ebe3a0ebc3a7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:55.355591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0cf9a467-0ceb-424f-a66a-ebe3a0ebc3a7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:55.362459 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0cf9a467-0ceb-424f-a66a-ebe3a0ebc3a7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.362949 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0cf9a467-0ceb-424f-a66a-ebe3a0ebc3a7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.363728 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0cf9a467-0ceb-424f-a66a-ebe3a0ebc3a7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:55.364168 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0cf9a467-0ceb-424f-a66a-ebe3a0ebc3a7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:55.393765 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0cf9a467-0ceb-424f-a66a-ebe3a0ebc3a7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Jul 18 02:41:55.394364 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 456/907] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:41:55 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:41:55.413283 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6bf3ac2d-8e9b-440a-ad97-d10a1e554a8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:55.420752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6bf3ac2d-8e9b-440a-ad97-d10a1e554a8b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.156267 Jul 18 02:41:55.421310 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 452/908] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:55 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:56.405213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fa94f304-6335-4a32-bea5-16b65e1c2902 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:56.406198 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fa94f304-6335-4a32-bea5-16b65e1c2902 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:56.412882 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fa94f304-6335-4a32-bea5-16b65e1c2902 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.413336 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fa94f304-6335-4a32-bea5-16b65e1c2902 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.414208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fa94f304-6335-4a32-bea5-16b65e1c2902 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.414648 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fa94f304-6335-4a32-bea5-16b65e1c2902 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.422223 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-9fd6040b-3f98-44b4-93a5-a6d31d619803 req-e65268fa-8232-4728-bd7c-0239c947fb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d47ffd3-9df5-400c-8cef-efcc7d6d97cd", "name": "network-vif-plugged", "status": "completed", "tag": "b0f73b8a-a342-4961-8be0-cc1c0a325389"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:41:56.431517 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-9fd6040b-3f98-44b4-93a5-a6d31d619803 req-e65268fa-8232-4728-bd7c-0239c947fb6d service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.431970 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-9fd6040b-3f98-44b4-93a5-a6d31d619803 req-e65268fa-8232-4728-bd7c-0239c947fb6d service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.443730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-9fd6040b-3f98-44b4-93a5-a6d31d619803 req-e65268fa-8232-4728-bd7c-0239c947fb6d service nova] Creating event network-vif-plugged:b0f73b8a-a342-4961-8be0-cc1c0a325389 for instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd on hv-cinder-85001 Jul 18 02:41:56.446101 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fa94f304-6335-4a32-bea5-16b65e1c2902 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Jul 18 02:41:56.446682 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 457/909] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:41:56 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:56.448669 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-9fd6040b-3f98-44b4-93a5-a6d31d619803 req-e65268fa-8232-4728-bd7c-0239c947fb6d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030126 Jul 18 02:41:56.450334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 453/910] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:41:56.452261 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fc235ee9-6fc5-47be-87cc-2f6f3ce59b75 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:56.452916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fc235ee9-6fc5-47be-87cc-2f6f3ce59b75 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:56.458749 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fc235ee9-6fc5-47be-87cc-2f6f3ce59b75 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.459237 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fc235ee9-6fc5-47be-87cc-2f6f3ce59b75 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.460001 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fc235ee9-6fc5-47be-87cc-2f6f3ce59b75 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:56.460476 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fc235ee9-6fc5-47be-87cc-2f6f3ce59b75 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:56.597426 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fc235ee9-6fc5-47be-87cc-2f6f3ce59b75 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:56.605777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fc235ee9-6fc5-47be-87cc-2f6f3ce59b75 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.157901 Jul 18 02:41:56.606753 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 458/911] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:56 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:57.459598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0f841554-5dd6-418a-922d-d964d08dcbb9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:57.460686 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0f841554-5dd6-418a-922d-d964d08dcbb9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:57.467429 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0f841554-5dd6-418a-922d-d964d08dcbb9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.467884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0f841554-5dd6-418a-922d-d964d08dcbb9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.468644 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0f841554-5dd6-418a-922d-d964d08dcbb9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.469081 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0f841554-5dd6-418a-922d-d964d08dcbb9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.500607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0f841554-5dd6-418a-922d-d964d08dcbb9 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046009 Jul 18 02:41:57.501154 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 454/912] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:41:57 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:57.622770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5f06f8e1-c9dc-4029-b6fc-8d6b214fdc61 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:57.623383 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5f06f8e1-c9dc-4029-b6fc-8d6b214fdc61 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:57.630020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f06f8e1-c9dc-4029-b6fc-8d6b214fdc61 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.630509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f06f8e1-c9dc-4029-b6fc-8d6b214fdc61 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.631278 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f06f8e1-c9dc-4029-b6fc-8d6b214fdc61 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:57.631719 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5f06f8e1-c9dc-4029-b6fc-8d6b214fdc61 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:57.770192 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5f06f8e1-c9dc-4029-b6fc-8d6b214fdc61 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:57.778435 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5f06f8e1-c9dc-4029-b6fc-8d6b214fdc61 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1266 microversion: 2.1 time: 0.160125 Jul 18 02:41:57.779012 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 459/913] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:57 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:58.512842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-bb293ba4-01df-4b00-b144-20bd1afdb1b5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:58.513785 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-bb293ba4-01df-4b00-b144-20bd1afdb1b5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:58.521082 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bb293ba4-01df-4b00-b144-20bd1afdb1b5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:58.521542 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bb293ba4-01df-4b00-b144-20bd1afdb1b5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:58.522355 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bb293ba4-01df-4b00-b144-20bd1afdb1b5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:58.522797 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-bb293ba4-01df-4b00-b144-20bd1afdb1b5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:58.555252 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-bb293ba4-01df-4b00-b144-20bd1afdb1b5 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046826 Jul 18 02:41:58.555821 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 455/914] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:41:58 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:41:58.795750 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e5591c45-abd4-46ae-b024-0536c2e47f18 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:58.796997 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e5591c45-abd4-46ae-b024-0536c2e47f18 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:58.804067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e5591c45-abd4-46ae-b024-0536c2e47f18 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:58.804777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e5591c45-abd4-46ae-b024-0536c2e47f18 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:58.806056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e5591c45-abd4-46ae-b024-0536c2e47f18 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:58.806939 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e5591c45-abd4-46ae-b024-0536c2e47f18 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:58.979507 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e5591c45-abd4-46ae-b024-0536c2e47f18 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:58.987720 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e5591c45-abd4-46ae-b024-0536c2e47f18 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1453 microversion: 2.1 time: 0.196266 Jul 18 02:41:58.988298 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 460/915] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:58 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:59.004655 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a725c927-25d3-402a-97b7-1e71bf433a7f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:59.005202 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a725c927-25d3-402a-97b7-1e71bf433a7f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:59.011357 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a725c927-25d3-402a-97b7-1e71bf433a7f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:59.011816 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a725c927-25d3-402a-97b7-1e71bf433a7f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:59.012593 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a725c927-25d3-402a-97b7-1e71bf433a7f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:59.013030 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a725c927-25d3-402a-97b7-1e71bf433a7f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:59.381230 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a725c927-25d3-402a-97b7-1e71bf433a7f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:41:59.389791 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a725c927-25d3-402a-97b7-1e71bf433a7f tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1453 microversion: 2.1 time: 0.389087 Jul 18 02:41:59.390405 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 456/916] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:41:58 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1453 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:41:59.567817 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-892852ef-a683-4beb-ba7e-0148e37e6272 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:41:59.568748 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-892852ef-a683-4beb-ba7e-0148e37e6272 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:41:59.575604 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-892852ef-a683-4beb-ba7e-0148e37e6272 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:59.576003 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-892852ef-a683-4beb-ba7e-0148e37e6272 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:59.576772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-892852ef-a683-4beb-ba7e-0148e37e6272 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:41:59.577214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-892852ef-a683-4beb-ba7e-0148e37e6272 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:41:59.606206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-892852ef-a683-4beb-ba7e-0148e37e6272 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042490 Jul 18 02:41:59.607146 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 461/917] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:41:59 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:00.620764 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5ec80420-48bd-49e6-b93c-868be0c25bec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:00.621281 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-5ec80420-48bd-49e6-b93c-868be0c25bec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:00.630328 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5ec80420-48bd-49e6-b93c-868be0c25bec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:00.630838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5ec80420-48bd-49e6-b93c-868be0c25bec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:00.631771 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5ec80420-48bd-49e6-b93c-868be0c25bec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:00.632206 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5ec80420-48bd-49e6-b93c-868be0c25bec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:00.662269 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5ec80420-48bd-49e6-b93c-868be0c25bec tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046861 Jul 18 02:42:00.662750 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 457/918] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:00 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:01.673326 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-57817fea-3b8a-47b8-bec9-af9368991f75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:01.674408 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-57817fea-3b8a-47b8-bec9-af9368991f75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:01.682365 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-57817fea-3b8a-47b8-bec9-af9368991f75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:01.683061 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-57817fea-3b8a-47b8-bec9-af9368991f75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:01.684911 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-57817fea-3b8a-47b8-bec9-af9368991f75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:01.686231 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-57817fea-3b8a-47b8-bec9-af9368991f75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:01.723288 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-57817fea-3b8a-47b8-bec9-af9368991f75 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054009 Jul 18 02:42:01.724068 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 462/919] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:01 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:01.851685 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-8c4088d2-a6d0-4e83-8493-9313f39bdda0 req-7ead2b39-addf-4b00-b102-b4b5ab165278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d47ffd3-9df5-400c-8cef-efcc7d6d97cd", "tag": "b0f73b8a-a342-4961-8be0-cc1c0a325389"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:01.861011 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-8c4088d2-a6d0-4e83-8493-9313f39bdda0 req-7ead2b39-addf-4b00-b102-b4b5ab165278 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:01.861478 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-8c4088d2-a6d0-4e83-8493-9313f39bdda0 req-7ead2b39-addf-4b00-b102-b4b5ab165278 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:01.874564 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-8c4088d2-a6d0-4e83-8493-9313f39bdda0 req-7ead2b39-addf-4b00-b102-b4b5ab165278 service nova] Creating event network-changed:b0f73b8a-a342-4961-8be0-cc1c0a325389 for instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd on hv-cinder-85001 Jul 18 02:42:01.879984 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-8c4088d2-a6d0-4e83-8493-9313f39bdda0 req-7ead2b39-addf-4b00-b102-b4b5ab165278 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032198 Jul 18 02:42:01.880605 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 458/920] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:02.738939 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5b2f6aaa-52d5-4a8c-99ec-0d7b7109dbb1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:02.739881 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5b2f6aaa-52d5-4a8c-99ec-0d7b7109dbb1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:02.746704 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b2f6aaa-52d5-4a8c-99ec-0d7b7109dbb1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.747249 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b2f6aaa-52d5-4a8c-99ec-0d7b7109dbb1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.748027 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b2f6aaa-52d5-4a8c-99ec-0d7b7109dbb1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:02.748465 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b2f6aaa-52d5-4a8c-99ec-0d7b7109dbb1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:02.798998 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5b2f6aaa-52d5-4a8c-99ec-0d7b7109dbb1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066737 Jul 18 02:42:02.800322 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 463/921] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:02 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:03.812479 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-23d91c89-3990-4c15-95c9-4ac45a9f6978 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:03.813604 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-23d91c89-3990-4c15-95c9-4ac45a9f6978 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:03.820515 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-23d91c89-3990-4c15-95c9-4ac45a9f6978 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:03.820973 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-23d91c89-3990-4c15-95c9-4ac45a9f6978 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:03.821747 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-23d91c89-3990-4c15-95c9-4ac45a9f6978 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:03.822215 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-23d91c89-3990-4c15-95c9-4ac45a9f6978 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:03.852615 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-23d91c89-3990-4c15-95c9-4ac45a9f6978 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Jul 18 02:42:03.859556 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 459/922] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:03 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:04.231994 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9988beb4-278f-4f5a-a1c9-0265636d4d2b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:04.232898 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9988beb4-278f-4f5a-a1c9-0265636d4d2b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:04.239283 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9988beb4-278f-4f5a-a1c9-0265636d4d2b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.239771 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9988beb4-278f-4f5a-a1c9-0265636d4d2b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.240535 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9988beb4-278f-4f5a-a1c9-0265636d4d2b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.240966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9988beb4-278f-4f5a-a1c9-0265636d4d2b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.255204 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:04.270953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9988beb4-278f-4f5a-a1c9-0265636d4d2b tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043543 Jul 18 02:42:04.271497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 464/923] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:04 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:04.407889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6547c568-bdb0-4c7f-837e-555f3e2dcb2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:04.408216 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6547c568-bdb0-4c7f-837e-555f3e2dcb2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:04.414334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6547c568-bdb0-4c7f-837e-555f3e2dcb2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.414795 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6547c568-bdb0-4c7f-837e-555f3e2dcb2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.415642 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6547c568-bdb0-4c7f-837e-555f3e2dcb2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.416088 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6547c568-bdb0-4c7f-837e-555f3e2dcb2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.450964 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6547c568-bdb0-4c7f-837e-555f3e2dcb2c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments/ac671bbd-431f-4b08-8664-846a41169628" status: 200 len: 194 microversion: 2.1 time: 0.046957 Jul 18 02:42:04.451575 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 460/924] 10.222.0.66 () {58 vars in 1412 bytes} [Mon Jul 18 02:42:04 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments/ac671bbd-431f-4b08-8664-846a41169628 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:04.461745 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d12bc964-f331-4449-b4ba-63d8ea5fb135 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:04.462296 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d12bc964-f331-4449-b4ba-63d8ea5fb135 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:04.469389 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d12bc964-f331-4449-b4ba-63d8ea5fb135 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.469847 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d12bc964-f331-4449-b4ba-63d8ea5fb135 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.470675 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d12bc964-f331-4449-b4ba-63d8ea5fb135 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.471429 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d12bc964-f331-4449-b4ba-63d8ea5fb135 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.558346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-d12bc964-f331-4449-b4ba-63d8ea5fb135 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lazy-loading 'services' on Instance uuid c2211074-6d69-4b22-b254-ea00a4ecc4c6 {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:42:04.865051 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-84b93ca3-683b-4b60-baf9-386159cf1470 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:04.865921 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-84b93ca3-683b-4b60-baf9-386159cf1470 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:04.872563 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-84b93ca3-683b-4b60-baf9-386159cf1470 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.873019 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-84b93ca3-683b-4b60-baf9-386159cf1470 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.873790 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-84b93ca3-683b-4b60-baf9-386159cf1470 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.874286 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-84b93ca3-683b-4b60-baf9-386159cf1470 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.903178 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-84b93ca3-683b-4b60-baf9-386159cf1470 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041373 Jul 18 02:42:04.903788 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 461/925] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:04 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 02:42:04.958466 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d12bc964-f331-4449-b4ba-63d8ea5fb135 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments/ac671bbd-431f-4b08-8664-846a41169628" status: 202 len: 0 microversion: 2.1 time: 0.500636 Jul 18 02:42:04.959084 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 465/926] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:42:04 2022] DELETE /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments/ac671bbd-431f-4b08-8664-846a41169628 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:42:04.960515 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c31d7b0a-19fd-4bae-9c9c-a38f02344820 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:04.961009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c31d7b0a-19fd-4bae-9c9c-a38f02344820 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:04.967831 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c31d7b0a-19fd-4bae-9c9c-a38f02344820 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.968278 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c31d7b0a-19fd-4bae-9c9c-a38f02344820 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.969038 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c31d7b0a-19fd-4bae-9c9c-a38f02344820 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:04.969470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c31d7b0a-19fd-4bae-9c9c-a38f02344820 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:04.984701 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:04.997581 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c31d7b0a-19fd-4bae-9c9c-a38f02344820 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Going to try to terminate instance {{(pid=124890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:42:05.320680 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c31d7b0a-19fd-4bae-9c9c-a38f02344820 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 204 len: 0 microversion: 2.1 time: 0.363720 Jul 18 02:42:05.321275 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 462/927] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:42:04 2022] DELETE /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 02:42:05.331066 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5db5f3fd-dcb9-478f-a1b0-c28c414571cd tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:05.331768 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5db5f3fd-dcb9-478f-a1b0-c28c414571cd tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:05.338010 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5db5f3fd-dcb9-478f-a1b0-c28c414571cd tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:05.338497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5db5f3fd-dcb9-478f-a1b0-c28c414571cd tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:05.339254 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5db5f3fd-dcb9-478f-a1b0-c28c414571cd tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:05.340394 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5db5f3fd-dcb9-478f-a1b0-c28c414571cd tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:05.476242 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5db5f3fd-dcb9-478f-a1b0-c28c414571cd tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:05.484818 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5db5f3fd-dcb9-478f-a1b0-c28c414571cd tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1682 microversion: 2.1 time: 0.158448 Jul 18 02:42:05.485393 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 466/928] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:05 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:06.502077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2a9d8008-815e-4871-a14a-5209fd56b347 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:06.502801 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2a9d8008-815e-4871-a14a-5209fd56b347 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:06.509287 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a9d8008-815e-4871-a14a-5209fd56b347 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:06.509683 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a9d8008-815e-4871-a14a-5209fd56b347 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:06.510501 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a9d8008-815e-4871-a14a-5209fd56b347 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:06.510934 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a9d8008-815e-4871-a14a-5209fd56b347 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:06.641340 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2a9d8008-815e-4871-a14a-5209fd56b347 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:06.649470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2a9d8008-815e-4871-a14a-5209fd56b347 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1682 microversion: 2.1 time: 0.151645 Jul 18 02:42:06.650032 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 463/929] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:06 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:07.668796 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cd7f8ecc-ca03-45d4-b5fe-3d5b1e17a483 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:07.669465 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-cd7f8ecc-ca03-45d4-b5fe-3d5b1e17a483 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:07.676126 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd7f8ecc-ca03-45d4-b5fe-3d5b1e17a483 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:07.676750 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd7f8ecc-ca03-45d4-b5fe-3d5b1e17a483 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:07.677636 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd7f8ecc-ca03-45d4-b5fe-3d5b1e17a483 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:07.678480 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cd7f8ecc-ca03-45d4-b5fe-3d5b1e17a483 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:07.808268 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-cd7f8ecc-ca03-45d4-b5fe-3d5b1e17a483 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:07.816838 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-cd7f8ecc-ca03-45d4-b5fe-3d5b1e17a483 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1682 microversion: 2.1 time: 0.152805 Jul 18 02:42:07.817416 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 467/930] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:07 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:42:08.194337 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5b15a241-f428-4350-b63a-986dd14ef8df tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:08.194936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-5b15a241-f428-4350-b63a-986dd14ef8df tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:08.202261 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5b15a241-f428-4350-b63a-986dd14ef8df tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.202711 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5b15a241-f428-4350-b63a-986dd14ef8df tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.203473 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5b15a241-f428-4350-b63a-986dd14ef8df tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.203908 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5b15a241-f428-4350-b63a-986dd14ef8df tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.236449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5b15a241-f428-4350-b63a-986dd14ef8df tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments/52535eaa-148a-43b7-baab-ebfbea1b6014" status: 200 len: 194 microversion: 2.1 time: 0.046031 Jul 18 02:42:08.237142 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 464/931] 10.222.0.66 () {58 vars in 1412 bytes} [Mon Jul 18 02:42:08 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments/52535eaa-148a-43b7-baab-ebfbea1b6014 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:08.247866 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ded9c568-a97b-4426-9b40-65032b02b8a6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:08.248368 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ded9c568-a97b-4426-9b40-65032b02b8a6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:08.254679 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ded9c568-a97b-4426-9b40-65032b02b8a6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.255131 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ded9c568-a97b-4426-9b40-65032b02b8a6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.256118 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ded9c568-a97b-4426-9b40-65032b02b8a6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.256640 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ded9c568-a97b-4426-9b40-65032b02b8a6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.346681 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-ded9c568-a97b-4426-9b40-65032b02b8a6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lazy-loading 'services' on Instance uuid c2211074-6d69-4b22-b254-ea00a4ecc4c6 {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:42:08.594833 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ded9c568-a97b-4426-9b40-65032b02b8a6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments/52535eaa-148a-43b7-baab-ebfbea1b6014" status: 202 len: 0 microversion: 2.1 time: 0.351127 Jul 18 02:42:08.595428 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 468/932] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:42:08 2022] DELETE /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments/52535eaa-148a-43b7-baab-ebfbea1b6014 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:42:08.788157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-88edb540-0b52-4abc-a172-1bb113acac7c req-8f29cd6f-fbd3-4a92-b38a-db51a8d13227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85324481-a04a-4d16-b72d-6a355b0775d0", "name": "network-vif-deleted", "tag": "09ed14d6-d57e-45f3-ae2a-c4a16c9aba4d"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:08.799373 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-88edb540-0b52-4abc-a172-1bb113acac7c req-8f29cd6f-fbd3-4a92-b38a-db51a8d13227 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.799971 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-88edb540-0b52-4abc-a172-1bb113acac7c req-8f29cd6f-fbd3-4a92-b38a-db51a8d13227 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.812390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-88edb540-0b52-4abc-a172-1bb113acac7c req-8f29cd6f-fbd3-4a92-b38a-db51a8d13227 service nova] Creating event network-vif-deleted:09ed14d6-d57e-45f3-ae2a-c4a16c9aba4d for instance 85324481-a04a-4d16-b72d-6a355b0775d0 on hv-cinder-85001 Jul 18 02:42:08.817900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-88edb540-0b52-4abc-a172-1bb113acac7c req-8f29cd6f-fbd3-4a92-b38a-db51a8d13227 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039643 Jul 18 02:42:08.819170 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 465/933] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:08.835731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-99c5ac87-d77e-41dd-9d62-73f7b9e4d3d7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:08.836428 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-99c5ac87-d77e-41dd-9d62-73f7b9e4d3d7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:08.842964 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99c5ac87-d77e-41dd-9d62-73f7b9e4d3d7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.843461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99c5ac87-d77e-41dd-9d62-73f7b9e4d3d7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.844420 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99c5ac87-d77e-41dd-9d62-73f7b9e4d3d7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:08.844860 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-99c5ac87-d77e-41dd-9d62-73f7b9e4d3d7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:08.916003 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-99c5ac87-d77e-41dd-9d62-73f7b9e4d3d7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:08.925377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-99c5ac87-d77e-41dd-9d62-73f7b9e4d3d7 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1615 microversion: 2.1 time: 0.094495 Jul 18 02:42:08.925969 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 469/934] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:08 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:09.944508 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:09.945201 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:09.952329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:09.952800 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:09.953582 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:09.954010 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:09.984935 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:09.985384 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:09.985830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lazy-loading 'fault' on Instance uuid 85324481-a04a-4d16-b72d-6a355b0775d0 {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:42:10.030386 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94c16391d39f4498a55c89bf2838788f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b02a417904a474abcab1eec5cea9c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:10.037945 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0d473916-9aa5-4df3-bbd1-832601a84817 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 200 len: 1332 microversion: 2.1 time: 0.098142 Jul 18 02:42:10.038716 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 466/935] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:09 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:10.811563 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3f599a28-48ae-45d1-812e-80591f3902ff tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:10.812590 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3f599a28-48ae-45d1-812e-80591f3902ff tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:10.819319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f599a28-48ae-45d1-812e-80591f3902ff tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:10.819779 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f599a28-48ae-45d1-812e-80591f3902ff tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:10.820608 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f599a28-48ae-45d1-812e-80591f3902ff tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:10.821047 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3f599a28-48ae-45d1-812e-80591f3902ff tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:10.849929 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3f599a28-48ae-45d1-812e-80591f3902ff tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042688 Jul 18 02:42:10.850500 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 470/936] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:10 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:11.055451 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-47b2607b-714b-4a3d-80f6-9d1ddf6112c1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:11.056063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-47b2607b-714b-4a3d-80f6-9d1ddf6112c1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:11.062947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-47b2607b-714b-4a3d-80f6-9d1ddf6112c1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.063407 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-47b2607b-714b-4a3d-80f6-9d1ddf6112c1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.064178 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-47b2607b-714b-4a3d-80f6-9d1ddf6112c1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.064627 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-47b2607b-714b-4a3d-80f6-9d1ddf6112c1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.078246 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-47b2607b-714b-4a3d-80f6-9d1ddf6112c1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-47b2607b-714b-4a3d-80f6-9d1ddf6112c1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 HTTP/1.1 Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:11.079900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:11.081554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '85324481-a04a-4d16-b72d-6a355b0775d0'} Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:11.082653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:11.084174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:11.085661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-47b2607b-714b-4a3d-80f6-9d1ddf6112c1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:11.085661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-47b2607b-714b-4a3d-80f6-9d1ddf6112c1 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 404 len: 111 microversion: 2.1 time: 0.029821 Jul 18 02:42:11.085661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 467/937] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:11 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:11.090901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-75f8ba84-042e-421f-bedc-17e12967fc22 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '.version_select at 0x7f28f2e69430>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:11.188957 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-75f8ba84-042e-421f-bedc-17e12967fc22 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979378916" status: 202 len: 0 microversion: 2.1 time: 0.102319 Jul 18 02:42:11.189480 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 471/938] 10.222.0.66 () {58 vars in 1220 bytes} [Mon Jul 18 02:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979378916 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:42:11.861867 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a47b2a4c-b8da-4838-a854-c768cee3d744 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:11.862900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a47b2a4c-b8da-4838-a854-c768cee3d744 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:11.869014 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a47b2a4c-b8da-4838-a854-c768cee3d744 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.869471 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a47b2a4c-b8da-4838-a854-c768cee3d744 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.870279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a47b2a4c-b8da-4838-a854-c768cee3d744 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:11.870783 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a47b2a4c-b8da-4838-a854-c768cee3d744 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:11.902809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a47b2a4c-b8da-4838-a854-c768cee3d744 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044971 Jul 18 02:42:11.903374 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 468/939] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:11 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:12.915177 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ff2983c1-fd26-451a-8f4e-6640fbf4708a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:12.916124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ff2983c1-fd26-451a-8f4e-6640fbf4708a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:12.923378 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ff2983c1-fd26-451a-8f4e-6640fbf4708a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:12.923903 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ff2983c1-fd26-451a-8f4e-6640fbf4708a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:12.924670 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ff2983c1-fd26-451a-8f4e-6640fbf4708a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:12.925112 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ff2983c1-fd26-451a-8f4e-6640fbf4708a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:12.954549 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ff2983c1-fd26-451a-8f4e-6640fbf4708a tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043830 Jul 18 02:42:12.955108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 472/940] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:12 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:13.965850 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9b352323-95c5-4bd3-b94c-50b4890947e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:13.966717 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9b352323-95c5-4bd3-b94c-50b4890947e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:13.973374 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b352323-95c5-4bd3-b94c-50b4890947e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:13.973830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b352323-95c5-4bd3-b94c-50b4890947e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:13.974672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b352323-95c5-4bd3-b94c-50b4890947e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:13.975101 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b352323-95c5-4bd3-b94c-50b4890947e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.004398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9b352323-95c5-4bd3-b94c-50b4890947e2 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042609 Jul 18 02:42:14.004943 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 469/941] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:13 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:42:14.108714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4184a996-9a42-45b5-9c81-aa2ed101b0a5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:14.109636 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4184a996-9a42-45b5-9c81-aa2ed101b0a5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:14.116029 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4184a996-9a42-45b5-9c81-aa2ed101b0a5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.116480 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4184a996-9a42-45b5-9c81-aa2ed101b0a5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.117241 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4184a996-9a42-45b5-9c81-aa2ed101b0a5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.117703 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4184a996-9a42-45b5-9c81-aa2ed101b0a5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.145676 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4184a996-9a42-45b5-9c81-aa2ed101b0a5 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041490 Jul 18 02:42:14.146240 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 473/942] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:42:14 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:42:14.210845 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-66e8c739-16ff-40c6-85dc-4ff358ef6ea7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:14.211335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-66e8c739-16ff-40c6-85dc-4ff358ef6ea7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:14.217870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-66e8c739-16ff-40c6-85dc-4ff358ef6ea7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.218221 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-66e8c739-16ff-40c6-85dc-4ff358ef6ea7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.218975 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-66e8c739-16ff-40c6-85dc-4ff358ef6ea7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.219407 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-66e8c739-16ff-40c6-85dc-4ff358ef6ea7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.243368 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-66e8c739-16ff-40c6-85dc-4ff358ef6ea7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Going to try to terminate instance {{(pid=124890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:42:14.267460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fc7e5572-66a4-4c8a-b520-8f82bdd36948 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:14.268026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fc7e5572-66a4-4c8a-b520-8f82bdd36948 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:14.274382 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fc7e5572-66a4-4c8a-b520-8f82bdd36948 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.274837 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fc7e5572-66a4-4c8a-b520-8f82bdd36948 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.275612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fc7e5572-66a4-4c8a-b520-8f82bdd36948 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.276052 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fc7e5572-66a4-4c8a-b520-8f82bdd36948 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.291536 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-fc7e5572-66a4-4c8a-b520-8f82bdd36948 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fc7e5572-66a4-4c8a-b520-8f82bdd36948 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: DELETE /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 HTTP/1.1 Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:42:14.293250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:14.296529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '85324481-a04a-4d16-b72d-6a355b0775d0'} Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:14.297635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:14.299062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:14.300264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fc7e5572-66a4-4c8a-b520-8f82bdd36948 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:14.300264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fc7e5572-66a4-4c8a-b520-8f82bdd36948 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 404 len: 111 microversion: 2.1 time: 0.031400 Jul 18 02:42:14.300264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 474/943] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:42:14 2022] DELETE /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:42:14.305447 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-20c13107-0de2-4dad-9093-38314c882038 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:14.305447 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-20c13107-0de2-4dad-9093-38314c882038 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 85324481-a04a-4d16-b72d-6a355b0775d0] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:14.310543 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-20c13107-0de2-4dad-9093-38314c882038 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.311248 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-20c13107-0de2-4dad-9093-38314c882038 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.312089 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-20c13107-0de2-4dad-9093-38314c882038 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.312733 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-20c13107-0de2-4dad-9093-38314c882038 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-20c13107-0de2-4dad-9093-38314c882038 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-20c13107-0de2-4dad-9093-38314c882038 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 HTTP/1.1 Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:42:14.330759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:14.332114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '85324481-a04a-4d16-b72d-6a355b0775d0'} Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:14.332916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. Jul 18 02:42:14.334315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:14.335827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-20c13107-0de2-4dad-9093-38314c882038 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance 85324481-a04a-4d16-b72d-6a355b0775d0 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:14.335827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-20c13107-0de2-4dad-9093-38314c882038 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0" status: 404 len: 111 microversion: 2.1 time: 0.030489 Jul 18 02:42:14.335827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 475/944] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:14 2022] GET /compute/v2.1/servers/85324481-a04a-4d16-b72d-6a355b0775d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:42:14.566844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-66e8c739-16ff-40c6-85dc-4ff358ef6ea7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 204 len: 0 microversion: 2.1 time: 0.359390 Jul 18 02:42:14.567498 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 470/945] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:42:14 2022] DELETE /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:42:14.576176 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-45e29c28-7596-4288-8d0d-753c45df1424 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:14.580836 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-45e29c28-7596-4288-8d0d-753c45df1424 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:14.583046 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-45e29c28-7596-4288-8d0d-753c45df1424 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.583502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-45e29c28-7596-4288-8d0d-753c45df1424 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.584271 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-45e29c28-7596-4288-8d0d-753c45df1424 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:14.584718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-45e29c28-7596-4288-8d0d-753c45df1424 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:14.726474 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-45e29c28-7596-4288-8d0d-753c45df1424 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:14.734406 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-45e29c28-7596-4288-8d0d-753c45df1424 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1673 microversion: 2.1 time: 0.162629 Jul 18 02:42:14.734990 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 476/946] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:14 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:15.605133 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b544cbf3-9c5b-45f1-9b3e-fa07210c3d85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:15.605734 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b544cbf3-9c5b-45f1-9b3e-fa07210c3d85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:15.612844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b544cbf3-9c5b-45f1-9b3e-fa07210c3d85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.612844 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b544cbf3-9c5b-45f1-9b3e-fa07210c3d85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.613492 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b544cbf3-9c5b-45f1-9b3e-fa07210c3d85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.613929 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b544cbf3-9c5b-45f1-9b3e-fa07210c3d85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.627342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-b544cbf3-9c5b-45f1-9b3e-fa07210c3d85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b544cbf3-9c5b-45f1-9b3e-fa07210c3d85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: DELETE /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc HTTP/1.1 Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:15.628989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:42:15.630612 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '5530cea9-7344-405e-bf59-9d4f629dddbc'} Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:15.631470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:42:15.633029 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.634603 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b544cbf3-9c5b-45f1-9b3e-fa07210c3d85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:15.634603 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b544cbf3-9c5b-45f1-9b3e-fa07210c3d85 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 404 len: 111 microversion: 2.1 time: 0.029618 Jul 18 02:42:15.634603 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 471/947] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:42:15 2022] DELETE /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:15.639440 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c43a228c-4a31-4344-959a-342a38091176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:15.640046 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c43a228c-4a31-4344-959a-342a38091176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5530cea9-7344-405e-bf59-9d4f629dddbc] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:15.646872 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c43a228c-4a31-4344-959a-342a38091176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.647331 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c43a228c-4a31-4344-959a-342a38091176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.648105 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c43a228c-4a31-4344-959a-342a38091176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.648547 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c43a228c-4a31-4344-959a-342a38091176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.662703 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-c43a228c-4a31-4344-959a-342a38091176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c43a228c-4a31-4344-959a-342a38091176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc HTTP/1.1 Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:42:15.675804 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:42:15.677363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '5530cea9-7344-405e-bf59-9d4f629dddbc'} Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:15.678351 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. Jul 18 02:42:15.679808 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.681134 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c43a228c-4a31-4344-959a-342a38091176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance 5530cea9-7344-405e-bf59-9d4f629dddbc could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:15.681134 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c43a228c-4a31-4344-959a-342a38091176 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc" status: 404 len: 111 microversion: 2.1 time: 0.030577 Jul 18 02:42:15.681134 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 477/948] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:15 2022] GET /compute/v2.1/servers/5530cea9-7344-405e-bf59-9d4f629dddbc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:15.683191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-175bc370-4979-4310-8701-f01ff932ffe3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:15.683785 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-175bc370-4979-4310-8701-f01ff932ffe3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:15.690832 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-175bc370-4979-4310-8701-f01ff932ffe3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.690832 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-175bc370-4979-4310-8701-f01ff932ffe3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.691541 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-175bc370-4979-4310-8701-f01ff932ffe3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.691970 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-175bc370-4979-4310-8701-f01ff932ffe3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.706169 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-175bc370-4979-4310-8701-f01ff932ffe3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-175bc370-4979-4310-8701-f01ff932ffe3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: DELETE /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b HTTP/1.1 Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:15.707842 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:42:15.709363 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '5b66be0c-5ad3-410b-94f2-74110dcffc9b'} Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:15.710244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:42:15.711531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.712727 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-175bc370-4979-4310-8701-f01ff932ffe3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:15.712727 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-175bc370-4979-4310-8701-f01ff932ffe3 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 404 len: 111 microversion: 2.1 time: 0.029969 Jul 18 02:42:15.712727 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 472/949] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:42:15 2022] DELETE /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:15.718674 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6ddb8048-88f3-4dd7-a1e1-1b377d9d5061 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:15.719292 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6ddb8048-88f3-4dd7-a1e1-1b377d9d5061 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: 5b66be0c-5ad3-410b-94f2-74110dcffc9b] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:15.725432 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ddb8048-88f3-4dd7-a1e1-1b377d9d5061 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.725886 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ddb8048-88f3-4dd7-a1e1-1b377d9d5061 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.726688 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ddb8048-88f3-4dd7-a1e1-1b377d9d5061 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.727150 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6ddb8048-88f3-4dd7-a1e1-1b377d9d5061 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.740731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-6ddb8048-88f3-4dd7-a1e1-1b377d9d5061 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6ddb8048-88f3-4dd7-a1e1-1b377d9d5061 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b HTTP/1.1 Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:42:15.744502 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:42:15.746423 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '5b66be0c-5ad3-410b-94f2-74110dcffc9b'} Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:15.747327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. Jul 18 02:42:15.749026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:15.750309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6ddb8048-88f3-4dd7-a1e1-1b377d9d5061 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance 5b66be0c-5ad3-410b-94f2-74110dcffc9b could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:15.750309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6ddb8048-88f3-4dd7-a1e1-1b377d9d5061 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b" status: 404 len: 111 microversion: 2.1 time: 0.029712 Jul 18 02:42:15.750309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 478/950] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:15 2022] GET /compute/v2.1/servers/5b66be0c-5ad3-410b-94f2-74110dcffc9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:15.762371 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c4fa9393-3bba-480d-9490-0095db8306e6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:15.763016 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c4fa9393-3bba-480d-9490-0095db8306e6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:15.769173 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c4fa9393-3bba-480d-9490-0095db8306e6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.769631 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c4fa9393-3bba-480d-9490-0095db8306e6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.770481 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c4fa9393-3bba-480d-9490-0095db8306e6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:15.770919 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c4fa9393-3bba-480d-9490-0095db8306e6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:15.905170 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c4fa9393-3bba-480d-9490-0095db8306e6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:15.912709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c4fa9393-3bba-480d-9490-0095db8306e6 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1673 microversion: 2.1 time: 0.154738 Jul 18 02:42:15.913264 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 473/951] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:15 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:16.929592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f4b6122f-4cae-4e89-bb58-81a5c7968d02 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:16.930221 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f4b6122f-4cae-4e89-bb58-81a5c7968d02 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:16.937493 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f4b6122f-4cae-4e89-bb58-81a5c7968d02 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:16.937945 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f4b6122f-4cae-4e89-bb58-81a5c7968d02 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:16.938735 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f4b6122f-4cae-4e89-bb58-81a5c7968d02 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:16.939918 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f4b6122f-4cae-4e89-bb58-81a5c7968d02 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:17.050615 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-11c89848-5bb9-45c1-ac36-207b397b6895 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:17.051329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-11c89848-5bb9-45c1-ac36-207b397b6895 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:17.053875 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:17.059412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-11c89848-5bb9-45c1-ac36-207b397b6895 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:17.059866 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-11c89848-5bb9-45c1-ac36-207b397b6895 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:17.060643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-11c89848-5bb9-45c1-ac36-207b397b6895 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:17.061441 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-11c89848-5bb9-45c1-ac36-207b397b6895 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:17.075599 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-11c89848-5bb9-45c1-ac36-207b397b6895 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-11c89848-5bb9-45c1-ac36-207b397b6895 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: DELETE /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 HTTP/1.1 Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:17.077183 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:42:17.078834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'b883c80f-57dd-43cb-a44e-72b33a2128e9'} Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:17.086327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:42:17.087824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:17.089048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-11c89848-5bb9-45c1-ac36-207b397b6895 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:17.089048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-11c89848-5bb9-45c1-ac36-207b397b6895 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 404 len: 111 microversion: 2.1 time: 0.031973 Jul 18 02:42:17.089048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 474/952] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:42:17 2022] DELETE /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:42:17.089048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2123c71c-3b17-4bf0-a921-750832276955 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:17.089048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2123c71c-3b17-4bf0-a921-750832276955 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] [instance: b883c80f-57dd-43cb-a44e-72b33a2128e9] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:17.094316 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2123c71c-3b17-4bf0-a921-750832276955 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:17.094803 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2123c71c-3b17-4bf0-a921-750832276955 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:17.095578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2123c71c-3b17-4bf0-a921-750832276955 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:17.096013 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2123c71c-3b17-4bf0-a921-750832276955 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:17.111132 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-2123c71c-3b17-4bf0-a921-750832276955 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] HTTP exception thrown: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2123c71c-3b17-4bf0-a921-750832276955 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Request method failure captured: Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 HTTP/1.1 Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkycYkaayqjCKOk4-yDIkkvqNlwSdarO_f6PVq488kSqIA_gV8V8npUdlSK4CO2S_J7gRtuXLTm2P2fChZZPoEvSpyzhDJ4f6gy38zScXlfen4ZAWL8VmV2BIyITeJcdv5LmCWq6whVaxdQlp07jD9Cgvz17gFFxa05XX8bF1P26U Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:17.115511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4b02a417904a474abcab1eec5cea9c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4b02a417904a474abcab1eec5cea9c7e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 4b02a417904a474abcab1eec5cea9c7e Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-205156533 Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 94c16391d39f4498a55c89bf2838788f Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeNegativeTest-205156533-project Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:42:17.117251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'b883c80f-57dd-43cb-a44e-72b33a2128e9'} Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:17.118325 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. Jul 18 02:42:17.119675 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:17.121557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2123c71c-3b17-4bf0-a921-750832276955 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] Returning 404 to user: Instance b883c80f-57dd-43cb-a44e-72b33a2128e9 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:17.121557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2123c71c-3b17-4bf0-a921-750832276955 tempest-AttachVolumeNegativeTest-205156533 tempest-AttachVolumeNegativeTest-205156533-project] 10.222.0.66 "GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9" status: 404 len: 111 microversion: 2.1 time: 0.030881 Jul 18 02:42:17.121557 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 475/953] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:17 2022] GET /compute/v2.1/servers/b883c80f-57dd-43cb-a44e-72b33a2128e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 02:42:17.195799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f4b6122f-4cae-4e89-bb58-81a5c7968d02 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:17.204242 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f4b6122f-4cae-4e89-bb58-81a5c7968d02 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1673 microversion: 2.1 time: 0.278404 Jul 18 02:42:17.213650 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 479/954] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:16 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1673 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:17.981074 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-4e2f60bf-87c9-4859-b041-828bbf32019c req-375d32bf-bafd-43fd-a81f-477d4ec5ad23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2211074-6d69-4b22-b254-ea00a4ecc4c6", "name": "network-vif-deleted", "tag": "88e1f36a-f13d-4fe9-af74-bfa7d331b96a"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:17.994350 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-4e2f60bf-87c9-4859-b041-828bbf32019c req-375d32bf-bafd-43fd-a81f-477d4ec5ad23 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:17.994798 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-4e2f60bf-87c9-4859-b041-828bbf32019c req-375d32bf-bafd-43fd-a81f-477d4ec5ad23 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:18.008023 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-4e2f60bf-87c9-4859-b041-828bbf32019c req-375d32bf-bafd-43fd-a81f-477d4ec5ad23 service nova] Creating event network-vif-deleted:88e1f36a-f13d-4fe9-af74-bfa7d331b96a for instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 on hv-cinder-85001 Jul 18 02:42:18.014458 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-4e2f60bf-87c9-4859-b041-828bbf32019c req-375d32bf-bafd-43fd-a81f-477d4ec5ad23 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042558 Jul 18 02:42:18.015695 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 476/955] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:18.220862 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-228afad4-c07c-434d-8acd-16a32ac239f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:18.221579 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-228afad4-c07c-434d-8acd-16a32ac239f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:18.230007 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-228afad4-c07c-434d-8acd-16a32ac239f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:18.230715 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-228afad4-c07c-434d-8acd-16a32ac239f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:18.231511 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-228afad4-c07c-434d-8acd-16a32ac239f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:18.231951 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-228afad4-c07c-434d-8acd-16a32ac239f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:18.297414 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-228afad4-c07c-434d-8acd-16a32ac239f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879f7a4cf6664e76bddffc804658b250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85204e1ae6844b70b45f8452887d5385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:18.305225 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-228afad4-c07c-434d-8acd-16a32ac239f7 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 200 len: 1322 microversion: 2.1 time: 0.088084 Jul 18 02:42:18.305805 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 480/956] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:18 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 1322 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:19.327634 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-69cf6fe1-125f-46bc-804d-6a9e90330709 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:19.329127 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-69cf6fe1-125f-46bc-804d-6a9e90330709 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:19.336026 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69cf6fe1-125f-46bc-804d-6a9e90330709 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:19.336856 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69cf6fe1-125f-46bc-804d-6a9e90330709 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:19.338125 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69cf6fe1-125f-46bc-804d-6a9e90330709 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:19.338784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-69cf6fe1-125f-46bc-804d-6a9e90330709 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:19.356330 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-69cf6fe1-125f-46bc-804d-6a9e90330709 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] HTTP exception thrown: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-69cf6fe1-125f-46bc-804d-6a9e90330709 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Request method failure captured: Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 HTTP/1.1 Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbfsUQCN5ay0wbB5exK1DXcdeD5aEED-ii59UVtO8NLEKzDf9s38DmNdG2mXY5zznMhqdDd5IqQiSnZIg74LbTn5ykm1o82q5ChmmwPVUPTWePMXG6lmdY3pPLDvDIu7qPgudsnNRSM4NGb3C_U47Ymyh3fTyxAVRFXIaM4IGa4lwY Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:19.359240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_85204e1ae6844b70b45f8452887d5385", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 879f7a4cf6664e76bddffc804658b250 Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:19.360622 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'c2211074-6d69-4b22-b254-ea00a4ecc4c6'} Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:19.361554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:19.363185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:19.364387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-69cf6fe1-125f-46bc-804d-6a9e90330709 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Returning 404 to user: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:19.364387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-69cf6fe1-125f-46bc-804d-6a9e90330709 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 404 len: 111 microversion: 2.1 time: 0.039344 Jul 18 02:42:19.364387 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 477/957] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:19 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:19.370198 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5d116bb4-c745-40af-9c9e-e709538e2058 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '.version_select at 0x7f28f2e69d30>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:19.512643 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5d116bb4-c745-40af-9c9e-e709538e2058 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071967315" status: 202 len: 0 microversion: 2.1 time: 0.145989 Jul 18 02:42:19.518380 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 481/958] 10.222.0.66 () {58 vars in 1220 bytes} [Mon Jul 18 02:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071967315 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:42:23.306220 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6786d428-8301-482b-944a-91263efbb030 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:23.306220 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6786d428-8301-482b-944a-91263efbb030 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:23.316024 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6786d428-8301-482b-944a-91263efbb030 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:23.316524 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6786d428-8301-482b-944a-91263efbb030 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:23.317487 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6786d428-8301-482b-944a-91263efbb030 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:23.317927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6786d428-8301-482b-944a-91263efbb030 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:23.343302 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-6786d428-8301-482b-944a-91263efbb030 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] HTTP exception thrown: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6786d428-8301-482b-944a-91263efbb030 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Request method failure captured: Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: DELETE /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 HTTP/1.1 Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbfsUQCN5ay0wbB5exK1DXcdeD5aEED-ii59UVtO8NLEKzDf9s38DmNdG2mXY5zznMhqdDd5IqQiSnZIg74LbTn5ykm1o82q5ChmmwPVUPTWePMXG6lmdY3pPLDvDIu7qPgudsnNRSM4NGb3C_U47Ymyh3fTyxAVRFXIaM4IGa4lwY Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:23.345118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_85204e1ae6844b70b45f8452887d5385", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 879f7a4cf6664e76bddffc804658b250 Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:23.347009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'c2211074-6d69-4b22-b254-ea00a4ecc4c6'} Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:23.347838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:23.349199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:23.351653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6786d428-8301-482b-944a-91263efbb030 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Returning 404 to user: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:23.356239 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6786d428-8301-482b-944a-91263efbb030 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 404 len: 111 microversion: 2.1 time: 0.053580 Jul 18 02:42:23.357119 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 478/959] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:42:23 2022] DELETE /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:23.365274 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d8e27b6d-13da-4884-8f54-a745b0c286c0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:23.365952 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d8e27b6d-13da-4884-8f54-a745b0c286c0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: c2211074-6d69-4b22-b254-ea00a4ecc4c6] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:23.373374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d8e27b6d-13da-4884-8f54-a745b0c286c0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:23.374117 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d8e27b6d-13da-4884-8f54-a745b0c286c0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:23.374646 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d8e27b6d-13da-4884-8f54-a745b0c286c0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:23.375088 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d8e27b6d-13da-4884-8f54-a745b0c286c0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:23.391052 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-d8e27b6d-13da-4884-8f54-a745b0c286c0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] HTTP exception thrown: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d8e27b6d-13da-4884-8f54-a745b0c286c0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Request method failure captured: Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 HTTP/1.1 Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbfsUQCN5ay0wbB5exK1DXcdeD5aEED-ii59UVtO8NLEKzDf9s38DmNdG2mXY5zznMhqdDd5IqQiSnZIg74LbTn5ykm1o82q5ChmmwPVUPTWePMXG6lmdY3pPLDvDIu7qPgudsnNRSM4NGb3C_U47Ymyh3fTyxAVRFXIaM4IGa4lwY Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:42:23.392821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_85204e1ae6844b70b45f8452887d5385", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 879f7a4cf6664e76bddffc804658b250 Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:23.394183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': 'c2211074-6d69-4b22-b254-ea00a4ecc4c6'} Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:23.403477 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. Jul 18 02:42:23.405200 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:23.406468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d8e27b6d-13da-4884-8f54-a745b0c286c0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Returning 404 to user: Instance c2211074-6d69-4b22-b254-ea00a4ecc4c6 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:23.406468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d8e27b6d-13da-4884-8f54-a745b0c286c0 tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6" status: 404 len: 111 microversion: 2.1 time: 0.033260 Jul 18 02:42:23.406468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 482/960] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:23 2022] GET /compute/v2.1/servers/c2211074-6d69-4b22-b254-ea00a4ecc4c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:24.732516 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6f96c246-b70e-4663-9934-0cc1da09451c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:24.733099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6f96c246-b70e-4663-9934-0cc1da09451c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:24.739620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6f96c246-b70e-4663-9934-0cc1da09451c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:24.740153 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6f96c246-b70e-4663-9934-0cc1da09451c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:24.740999 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6f96c246-b70e-4663-9934-0cc1da09451c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:24.741550 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6f96c246-b70e-4663-9934-0cc1da09451c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:24.755711 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-6f96c246-b70e-4663-9934-0cc1da09451c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] HTTP exception thrown: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6f96c246-b70e-4663-9934-0cc1da09451c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Request method failure captured: Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: DELETE /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 HTTP/1.1 Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbfsUQCN5ay0wbB5exK1DXcdeD5aEED-ii59UVtO8NLEKzDf9s38DmNdG2mXY5zznMhqdDd5IqQiSnZIg74LbTn5ykm1o82q5ChmmwPVUPTWePMXG6lmdY3pPLDvDIu7qPgudsnNRSM4NGb3C_U47Ymyh3fTyxAVRFXIaM4IGa4lwY Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:24.757267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_85204e1ae6844b70b45f8452887d5385", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 879f7a4cf6664e76bddffc804658b250 Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:42:24.762438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '6e1905a0-2c49-40f1-921a-0fda9997cdb3'} Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:24.763523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:42:24.764944 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:24.766505 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6f96c246-b70e-4663-9934-0cc1da09451c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Returning 404 to user: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:24.766505 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6f96c246-b70e-4663-9934-0cc1da09451c tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 404 len: 111 microversion: 2.1 time: 0.030524 Jul 18 02:42:24.766505 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 479/961] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:42:24 2022] DELETE /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:24.767922 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-09cdcd1e-6b9e-4d17-a66e-7ecc7ef79dad tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:24.768574 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-09cdcd1e-6b9e-4d17-a66e-7ecc7ef79dad tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] [instance: 6e1905a0-2c49-40f1-921a-0fda9997cdb3] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:24.775170 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-09cdcd1e-6b9e-4d17-a66e-7ecc7ef79dad tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:24.775626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-09cdcd1e-6b9e-4d17-a66e-7ecc7ef79dad tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:24.776448 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-09cdcd1e-6b9e-4d17-a66e-7ecc7ef79dad tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:24.776937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-09cdcd1e-6b9e-4d17-a66e-7ecc7ef79dad tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:24.791046 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-09cdcd1e-6b9e-4d17-a66e-7ecc7ef79dad tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] HTTP exception thrown: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-09cdcd1e-6b9e-4d17-a66e-7ecc7ef79dad tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Request method failure captured: Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 HTTP/1.1 Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbfsUQCN5ay0wbB5exK1DXcdeD5aEED-ii59UVtO8NLEKzDf9s38DmNdG2mXY5zznMhqdDd5IqQiSnZIg74LbTn5ykm1o82q5ChmmwPVUPTWePMXG6lmdY3pPLDvDIu7qPgudsnNRSM4NGb3C_U47Ymyh3fTyxAVRFXIaM4IGa4lwY Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:42:24.793293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/85204e1ae6844b70b45f8452887d5385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_85204e1ae6844b70b45f8452887d5385", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 85204e1ae6844b70b45f8452887d5385 Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159103899 Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 879f7a4cf6664e76bddffc804658b250 Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeTestJSON-1159103899-project Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:42:24.795130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '6e1905a0-2c49-40f1-921a-0fda9997cdb3'} Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:24.796110 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. Jul 18 02:42:24.797612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:24.799026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-09cdcd1e-6b9e-4d17-a66e-7ecc7ef79dad tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] Returning 404 to user: Instance 6e1905a0-2c49-40f1-921a-0fda9997cdb3 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:24.799026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-09cdcd1e-6b9e-4d17-a66e-7ecc7ef79dad tempest-AttachVolumeTestJSON-1159103899 tempest-AttachVolumeTestJSON-1159103899-project] 10.222.0.66 "GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3" status: 404 len: 111 microversion: 2.1 time: 0.030671 Jul 18 02:42:24.799026 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 483/962] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:42:24 2022] GET /compute/v2.1/servers/6e1905a0-2c49-40f1-921a-0fda9997cdb3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:42:28.925276 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-152576a8-7bfa-461f-830d-68c20e2ff3ae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:28.926268 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-152576a8-7bfa-461f-830d-68c20e2ff3ae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:28.932911 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-152576a8-7bfa-461f-830d-68c20e2ff3ae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:28.933896 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-152576a8-7bfa-461f-830d-68c20e2ff3ae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:28.934718 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-152576a8-7bfa-461f-830d-68c20e2ff3ae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:28.935143 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-152576a8-7bfa-461f-830d-68c20e2ff3ae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:28.964534 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-152576a8-7bfa-461f-830d-68c20e2ff3ae tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043179 Jul 18 02:42:28.965260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 480/963] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Jul 18 02:42:28 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:42:29.024773 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d904bcb6-f701-45d0-ac7e-bf4e3b171952 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:29.025337 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d904bcb6-f701-45d0-ac7e-bf4e3b171952 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:29.028179 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:29.032904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d904bcb6-f701-45d0-ac7e-bf4e3b171952 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:29.033349 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d904bcb6-f701-45d0-ac7e-bf4e3b171952 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:29.034134 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d904bcb6-f701-45d0-ac7e-bf4e3b171952 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:29.034576 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d904bcb6-f701-45d0-ac7e-bf4e3b171952 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:29.060212 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d904bcb6-f701-45d0-ac7e-bf4e3b171952 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:42:29.096441 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:29.461173 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d904bcb6-f701-45d0-ac7e-bf4e3b171952 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 204 len: 0 microversion: 2.20 time: 0.439915 Jul 18 02:42:29.461832 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 484/964] 10.222.0.66 () {60 vars in 1279 bytes} [Mon Jul 18 02:42:29 2022] DELETE /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:42:29.470620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fbf07e65-d11e-4e3e-9878-63fc03d9c7a5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:29.471268 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fbf07e65-d11e-4e3e-9878-63fc03d9c7a5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:29.477263 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fbf07e65-d11e-4e3e-9878-63fc03d9c7a5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:29.478499 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fbf07e65-d11e-4e3e-9878-63fc03d9c7a5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:29.484253 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fbf07e65-d11e-4e3e-9878-63fc03d9c7a5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:29.484253 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fbf07e65-d11e-4e3e-9878-63fc03d9c7a5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:29.664226 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fbf07e65-d11e-4e3e-9878-63fc03d9c7a5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:29.673031 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fbf07e65-d11e-4e3e-9878-63fc03d9c7a5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:29.679777 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-fbf07e65-d11e-4e3e-9878-63fc03d9c7a5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:29.679777 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fbf07e65-d11e-4e3e-9878-63fc03d9c7a5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.209480 Jul 18 02:42:29.679777 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 481/965] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:29 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:30.695590 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b25a1ddf-6a7c-4010-9b8c-ce5416c489c6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:30.696561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b25a1ddf-6a7c-4010-9b8c-ce5416c489c6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:30.708586 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b25a1ddf-6a7c-4010-9b8c-ce5416c489c6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:30.709274 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b25a1ddf-6a7c-4010-9b8c-ce5416c489c6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:30.710327 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b25a1ddf-6a7c-4010-9b8c-ce5416c489c6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:30.710830 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b25a1ddf-6a7c-4010-9b8c-ce5416c489c6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:30.855942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b25a1ddf-6a7c-4010-9b8c-ce5416c489c6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:30.863980 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b25a1ddf-6a7c-4010-9b8c-ce5416c489c6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:30.865487 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b25a1ddf-6a7c-4010-9b8c-ce5416c489c6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:30.866708 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b25a1ddf-6a7c-4010-9b8c-ce5416c489c6 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.175571 Jul 18 02:42:30.867318 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 485/966] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:30 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:31.885382 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5f8e02e6-0c8c-49f4-a92d-11d275760ea2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:31.886459 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-5f8e02e6-0c8c-49f4-a92d-11d275760ea2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:31.893307 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5f8e02e6-0c8c-49f4-a92d-11d275760ea2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:31.893760 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5f8e02e6-0c8c-49f4-a92d-11d275760ea2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:31.895900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5f8e02e6-0c8c-49f4-a92d-11d275760ea2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:31.895900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5f8e02e6-0c8c-49f4-a92d-11d275760ea2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:31.899335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:32.033279 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5f8e02e6-0c8c-49f4-a92d-11d275760ea2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:32.041232 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5f8e02e6-0c8c-49f4-a92d-11d275760ea2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:32.043067 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5f8e02e6-0c8c-49f4-a92d-11d275760ea2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:32.044562 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5f8e02e6-0c8c-49f4-a92d-11d275760ea2 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.163044 Jul 18 02:42:32.045114 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 482/967] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:31 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:33.068235 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6f7f543c-4dd6-4470-b363-edc9f42023ac tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:33.069405 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6f7f543c-4dd6-4470-b363-edc9f42023ac tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:33.076362 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f7f543c-4dd6-4470-b363-edc9f42023ac tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:33.093464 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f7f543c-4dd6-4470-b363-edc9f42023ac tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:33.093464 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f7f543c-4dd6-4470-b363-edc9f42023ac tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:33.093464 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f7f543c-4dd6-4470-b363-edc9f42023ac tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:33.307470 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6f7f543c-4dd6-4470-b363-edc9f42023ac tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:33.316377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6f7f543c-4dd6-4470-b363-edc9f42023ac tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:33.317879 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6f7f543c-4dd6-4470-b363-edc9f42023ac tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:33.319095 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6f7f543c-4dd6-4470-b363-edc9f42023ac tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1722 microversion: 2.20 time: 0.254675 Jul 18 02:42:33.319795 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 486/968] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:33 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:33.847245 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-a23e8e75-41c2-470b-8c72-5645764fc1b0 req-0bce1680-eedb-429e-a1e1-0b91ae180c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a", "name": "network-vif-deleted", "tag": "078d1890-a0ab-46d1-ac2c-464bd6da369c"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:42:33.857288 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-a23e8e75-41c2-470b-8c72-5645764fc1b0 req-0bce1680-eedb-429e-a1e1-0b91ae180c5f service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:33.857730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-a23e8e75-41c2-470b-8c72-5645764fc1b0 req-0bce1680-eedb-429e-a1e1-0b91ae180c5f service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:33.872192 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-a23e8e75-41c2-470b-8c72-5645764fc1b0 req-0bce1680-eedb-429e-a1e1-0b91ae180c5f service nova] Creating event network-vif-deleted:078d1890-a0ab-46d1-ac2c-464bd6da369c for instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a on hv-cinder-85001 Jul 18 02:42:33.887212 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-a23e8e75-41c2-470b-8c72-5645764fc1b0 req-0bce1680-eedb-429e-a1e1-0b91ae180c5f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042880 Jul 18 02:42:33.888476 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 483/969] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:42:34.337262 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:34.337878 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:34.344548 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:34.345004 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:34.345775 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:34.346252 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:34.525183 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:34.525647 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:34.526214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lazy-loading 'fault' on Instance uuid cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:42:34.577571 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:34.587549 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:34.589831 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ddb197852db4b20a84aa6c0862468ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c1745729fe47238223557221c2e905', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:42:34.591449 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1bd81352-ebc4-41ba-bbaa-7826c039313a tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 200 len: 1370 microversion: 2.20 time: 0.257925 Jul 18 02:42:34.593725 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 487/970] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:34 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 02:42:35.616102 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e647f167-b1da-4445-83e8-ab3e3d6fb74f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:35.617171 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e647f167-b1da-4445-83e8-ab3e3d6fb74f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:35.624896 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e647f167-b1da-4445-83e8-ab3e3d6fb74f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:35.625420 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e647f167-b1da-4445-83e8-ab3e3d6fb74f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:35.626222 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e647f167-b1da-4445-83e8-ab3e3d6fb74f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:35.626684 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e647f167-b1da-4445-83e8-ab3e3d6fb74f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:35.640901 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-e647f167-b1da-4445-83e8-ab3e3d6fb74f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] HTTP exception thrown: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e647f167-b1da-4445-83e8-ab3e3d6fb74f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Request method failure captured: Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a HTTP/1.1 Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkdXCXH6B-DfPmWoAtNMdORV523wv4eaywAxBpxNxeD7XAvm1nGTogJGHaztpFiri2zdF6kUtH7D7AyysIBMVKmrgybQcVWbX6BHRxEtCYHPKxONCMwmtyH1YQFwspHQLbYYKUogGt32bW5UfpokJWqXcbdhSToFC_zWNqur-XwL4 Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:35.642726 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f3c1745729fe47238223557221c2e905"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f3c1745729fe47238223557221c2e905", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 7ddb197852db4b20a84aa6c0862468ef Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:35.644521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a'} Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:35.645430 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:35.646752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:35.648332 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e647f167-b1da-4445-83e8-ab3e3d6fb74f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Returning 404 to user: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:35.648332 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e647f167-b1da-4445-83e8-ab3e3d6fb74f tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 404 len: 111 microversion: 2.20 time: 0.034439 Jul 18 02:42:35.648332 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 484/971] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:35 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:42:35.653676 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bf3372e7-b1ea-4c5d-b876-48075c8f698b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '.version_select at 0x7f28f2dd98b0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:35.768348 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bf3372e7-b1ea-4c5d-b876-48075c8f698b tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-71337549" status: 204 len: 0 microversion: 2.20 time: 0.118453 Jul 18 02:42:35.768919 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 488/972] 10.222.0.66 () {60 vars in 1255 bytes} [Mon Jul 18 02:42:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-71337549 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 02:42:37.888621 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fa362890-5571-40a2-a715-1060ef298c11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:37.889113 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fa362890-5571-40a2-a715-1060ef298c11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:37.895971 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa362890-5571-40a2-a715-1060ef298c11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:37.896429 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa362890-5571-40a2-a715-1060ef298c11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:37.897203 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa362890-5571-40a2-a715-1060ef298c11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:37.897643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fa362890-5571-40a2-a715-1060ef298c11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:37.912176 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-fa362890-5571-40a2-a715-1060ef298c11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] HTTP exception thrown: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fa362890-5571-40a2-a715-1060ef298c11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Request method failure captured: Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: DELETE /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a HTTP/1.1 Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkdXCXH6B-DfPmWoAtNMdORV523wv4eaywAxBpxNxeD7XAvm1nGTogJGHaztpFiri2zdF6kUtH7D7AyysIBMVKmrgybQcVWbX6BHRxEtCYHPKxONCMwmtyH1YQFwspHQLbYYKUogGt32bW5UfpokJWqXcbdhSToFC_zWNqur-XwL4 Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:37.913833 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f3c1745729fe47238223557221c2e905"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f3c1745729fe47238223557221c2e905", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 7ddb197852db4b20a84aa6c0862468ef Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:37.915628 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a'} Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:37.921390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:37.923157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:37.925018 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fa362890-5571-40a2-a715-1060ef298c11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Returning 404 to user: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:37.925018 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fa362890-5571-40a2-a715-1060ef298c11 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 404 len: 111 microversion: 2.20 time: 0.030593 Jul 18 02:42:37.925018 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 485/973] 10.222.0.66 () {60 vars in 1279 bytes} [Mon Jul 18 02:42:37 2022] DELETE /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:42:37.927947 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-69b1873f-6cf6-4e45-a1fa-9c3b953cefa8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:37.928730 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-69b1873f-6cf6-4e45-a1fa-9c3b953cefa8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:37.936214 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-69b1873f-6cf6-4e45-a1fa-9c3b953cefa8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:37.936611 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-69b1873f-6cf6-4e45-a1fa-9c3b953cefa8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:37.937658 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-69b1873f-6cf6-4e45-a1fa-9c3b953cefa8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:37.938124 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-69b1873f-6cf6-4e45-a1fa-9c3b953cefa8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:37.951472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-69b1873f-6cf6-4e45-a1fa-9c3b953cefa8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] HTTP exception thrown: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-69b1873f-6cf6-4e45-a1fa-9c3b953cefa8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Request method failure captured: Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a HTTP/1.1 Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbkdXCXH6B-DfPmWoAtNMdORV523wv4eaywAxBpxNxeD7XAvm1nGTogJGHaztpFiri2zdF6kUtH7D7AyysIBMVKmrgybQcVWbX6BHRxEtCYHPKxONCMwmtyH1YQFwspHQLbYYKUogGt32bW5UfpokJWqXcbdhSToFC_zWNqur-XwL4 Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:42:37.953129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f3c1745729fe47238223557221c2e905"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f3c1745729fe47238223557221c2e905", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 7ddb197852db4b20a84aa6c0862468ef Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:37.954807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': 'cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a'} Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:37.955594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. Jul 18 02:42:37.956846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:37.957934 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-69b1873f-6cf6-4e45-a1fa-9c3b953cefa8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Returning 404 to user: Instance cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:37.957934 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-69b1873f-6cf6-4e45-a1fa-9c3b953cefa8 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a" status: 404 len: 111 microversion: 2.20 time: 0.030351 Jul 18 02:42:37.957934 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 489/974] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:37 2022] GET /compute/v2.1/servers/cb1eb7ad-0e9f-49ec-86f5-f7be028c9b3a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 02:42:39.210591 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f1c69fb5-7bb8-4866-9140-c13c0f800cc5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:39.211091 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f1c69fb5-7bb8-4866-9140-c13c0f800cc5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:39.218196 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f1c69fb5-7bb8-4866-9140-c13c0f800cc5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:39.218652 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f1c69fb5-7bb8-4866-9140-c13c0f800cc5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:39.219481 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f1c69fb5-7bb8-4866-9140-c13c0f800cc5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:39.219912 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f1c69fb5-7bb8-4866-9140-c13c0f800cc5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:39.234292 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-f1c69fb5-7bb8-4866-9140-c13c0f800cc5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] HTTP exception thrown: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f1c69fb5-7bb8-4866-9140-c13c0f800cc5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Request method failure captured: Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: DELETE /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd HTTP/1.1 Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MbkdXCXH6B-DfPmWoAtNMdORV523wv4eaywAxBpxNxeD7XAvm1nGTogJGHaztpFiri2zdF6kUtH7D7AyysIBMVKmrgybQcVWbX6BHRxEtCYHPKxONCMwmtyH1YQFwspHQLbYYKUogGt32bW5UfpokJWqXcbdhSToFC_zWNqur-XwL4 Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:42:39.235884 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f3c1745729fe47238223557221c2e905"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f3c1745729fe47238223557221c2e905", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 7ddb197852db4b20a84aa6c0862468ef Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:42:39.237526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '68d974b9-4abf-4d7f-bbea-08e8fef381dd'} Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:39.238598 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:42:39.240099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:42:39.241730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f1c69fb5-7bb8-4866-9140-c13c0f800cc5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Returning 404 to user: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:39.241730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f1c69fb5-7bb8-4866-9140-c13c0f800cc5 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "DELETE /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 404 len: 111 microversion: 2.20 time: 0.030671 Jul 18 02:42:39.241730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 486/975] 10.222.0.66 () {60 vars in 1279 bytes} [Mon Jul 18 02:42:39 2022] DELETE /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:42:39.246374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-93e519e1-5674-4d34-a792-3a649c1a5864 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:42:39.246981 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-93e519e1-5674-4d34-a792-3a649c1a5864 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] [instance: 68d974b9-4abf-4d7f-bbea-08e8fef381dd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:42:39.253730 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93e519e1-5674-4d34-a792-3a649c1a5864 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:39.254215 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93e519e1-5674-4d34-a792-3a649c1a5864 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:39.254982 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93e519e1-5674-4d34-a792-3a649c1a5864 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:42:39.255422 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93e519e1-5674-4d34-a792-3a649c1a5864 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:42:39.268571 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-93e519e1-5674-4d34-a792-3a649c1a5864 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] HTTP exception thrown: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-93e519e1-5674-4d34-a792-3a649c1a5864 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Request method failure captured: Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd HTTP/1.1 Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MbkdXCXH6B-DfPmWoAtNMdORV523wv4eaywAxBpxNxeD7XAvm1nGTogJGHaztpFiri2zdF6kUtH7D7AyysIBMVKmrgybQcVWbX6BHRxEtCYHPKxONCMwmtyH1YQFwspHQLbYYKUogGt32bW5UfpokJWqXcbdhSToFC_zWNqur-XwL4 Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:42:39.270108 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f3c1745729fe47238223557221c2e905"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f3c1745729fe47238223557221c2e905"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f3c1745729fe47238223557221c2e905", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: f3c1745729fe47238223557221c2e905 Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-864722894 Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 7ddb197852db4b20a84aa6c0862468ef Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-AttachVolumeShelveTestJSON-864722894-project Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:42:39.271875 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '68d974b9-4abf-4d7f-bbea-08e8fef381dd'} Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:42:39.272920 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. Jul 18 02:42:39.274427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:42:39.280285 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-93e519e1-5674-4d34-a792-3a649c1a5864 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] Returning 404 to user: Instance 68d974b9-4abf-4d7f-bbea-08e8fef381dd could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:42:39.280285 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-93e519e1-5674-4d34-a792-3a649c1a5864 tempest-AttachVolumeShelveTestJSON-864722894 tempest-AttachVolumeShelveTestJSON-864722894-project] 10.222.0.66 "GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd" status: 404 len: 111 microversion: 2.20 time: 0.029501 Jul 18 02:42:39.280285 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 490/976] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Jul 18 02:42:39 2022] GET /compute/v2.1/servers/68d974b9-4abf-4d7f-bbea-08e8fef381dd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 02:43:03.230074 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=25 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:03.230872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=13 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:03.427473 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-52aa1fac-5979-4ab9-9f7f-89d55d0a7617 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Action: 'create', calling method: .version_select at 0x7f28edc41dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-443196027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZAanXFZqkV8s0XB1QpUPSQ33XZuUR7FJnQVYIacdYkhq4lDO9mMU17TE/ulfS3ytRWmzw2hJKShaY+LAXm36e/1j6WBzAERKbaTYDICGzfirXZvjYECf0/ctCxtfdmGQ=="}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:03.440357 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-52aa1fac-5979-4ab9-9f7f-89d55d0a7617 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Getting quotas for project 2fe363fe43ef4fd9aec026c4cdc3e18e. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:43:03.444332 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-52aa1fac-5979-4ab9-9f7f-89d55d0a7617 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Getting quotas for user 681d0f989d7d459e83a32066fd5ed0a2 and project 2fe363fe43ef4fd9aec026c4cdc3e18e. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:43:03.532920 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-52aa1fac-5979-4ab9-9f7f-89d55d0a7617 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.307662 Jul 18 02:43:03.533516 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 487/977] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 18 02:43:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:39.946657 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:39.947414 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:39.951374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-565252835", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-443196027", "security_groups": [{"name": "tempest-secgroup-smoke-890094191"}], "networks": [{"uuid": "0f0b9e2b-f4bb-4648-abfc-2e463ce9379f"}], "block_device_mapping_v2": [{"uuid": "2f892385-51da-4148-ac12-672644ed28e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:40.072264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] validate_networks() for [('0f0b9e2b-f4bb-4648-abfc-2e463ce9379f', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:43:40.462074 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:43:40.462074 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:43:40.462074 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:43:40.462500 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:43:40.462796 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:43:40.471948 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:40.472457 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:40.475014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:40.475014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:40.491955 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Getting quotas for project 2fe363fe43ef4fd9aec026c4cdc3e18e. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:43:40.495849 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Getting quotas for user 681d0f989d7d459e83a32066fd5ed0a2 and project 2fe363fe43ef4fd9aec026c4cdc3e18e. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:43:40.557278 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:43:40.559461 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f892385-51da-4148-ac12-672644ed28e0',volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:43:41.008374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-97dbea8e-7416-423e-b35b-62e8e5fcb85f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.063602 Jul 18 02:43:41.010007 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 491/978] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:43:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:43:41.017666 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=4 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:41.022008 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6d5de488-1866-4ff9-9161-b618b499ba3d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:41.022660 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6d5de488-1866-4ff9-9161-b618b499ba3d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:41.102651 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6d5de488-1866-4ff9-9161-b618b499ba3d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:41.111972 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6d5de488-1866-4ff9-9161-b618b499ba3d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1087 microversion: 2.1 time: 0.095730 Jul 18 02:43:41.115716 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 488/979] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:41 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1087 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:42.133615 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4f4ec3fc-c4e4-4163-bbf1-92fb6bbc1629 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:42.134303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4f4ec3fc-c4e4-4163-bbf1-92fb6bbc1629 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:42.197519 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4f4ec3fc-c4e4-4163-bbf1-92fb6bbc1629 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:42.205579 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4f4ec3fc-c4e4-4163-bbf1-92fb6bbc1629 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1087 microversion: 2.1 time: 0.076420 Jul 18 02:43:42.206162 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 492/980] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:42 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:43.032981 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:43:43.033561 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Mon Jul 18 02:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:43:43.223589 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6800ef09-ac8c-42e2-b3a9-ae3771ccab4b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:43.224274 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6800ef09-ac8c-42e2-b3a9-ae3771ccab4b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:43.282004 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6800ef09-ac8c-42e2-b3a9-ae3771ccab4b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:43.289518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6800ef09-ac8c-42e2-b3a9-ae3771ccab4b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1087 microversion: 2.1 time: 0.070432 Jul 18 02:43:43.290016 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 489/981] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:43 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:44.306333 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9a9be0ef-4c13-4646-822c-a96a00e7109d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:44.306943 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9a9be0ef-4c13-4646-822c-a96a00e7109d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:44.314465 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9a9be0ef-4c13-4646-822c-a96a00e7109d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:44.314852 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9a9be0ef-4c13-4646-822c-a96a00e7109d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:44.315621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9a9be0ef-4c13-4646-822c-a96a00e7109d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:44.316057 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9a9be0ef-4c13-4646-822c-a96a00e7109d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:44.376799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-9a9be0ef-4c13-4646-822c-a96a00e7109d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:44.384182 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9a9be0ef-4c13-4646-822c-a96a00e7109d tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1137 microversion: 2.1 time: 0.081680 Jul 18 02:43:44.388490 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 493/982] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:44 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:45.401187 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-92d8e229-c6bf-4239-9a8c-8d0acbcc3782 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:45.401801 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-92d8e229-c6bf-4239-9a8c-8d0acbcc3782 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:45.409084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-92d8e229-c6bf-4239-9a8c-8d0acbcc3782 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:45.409537 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-92d8e229-c6bf-4239-9a8c-8d0acbcc3782 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:45.410332 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-92d8e229-c6bf-4239-9a8c-8d0acbcc3782 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:45.410771 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-92d8e229-c6bf-4239-9a8c-8d0acbcc3782 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:45.472149 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-92d8e229-c6bf-4239-9a8c-8d0acbcc3782 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:45.479563 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-92d8e229-c6bf-4239-9a8c-8d0acbcc3782 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1129 microversion: 2.1 time: 0.082598 Jul 18 02:43:45.480124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 490/983] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:45 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1129 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:46.506558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-77df51d2-9e05-4f77-9360-1629a8fd91a6 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:46.507186 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-77df51d2-9e05-4f77-9360-1629a8fd91a6 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:46.517470 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-77df51d2-9e05-4f77-9360-1629a8fd91a6 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:46.518023 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-77df51d2-9e05-4f77-9360-1629a8fd91a6 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:46.519191 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-77df51d2-9e05-4f77-9360-1629a8fd91a6 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:46.520627 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-77df51d2-9e05-4f77-9360-1629a8fd91a6 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:46.611307 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-77df51d2-9e05-4f77-9360-1629a8fd91a6 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:46.626313 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-77df51d2-9e05-4f77-9360-1629a8fd91a6 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1193 microversion: 2.1 time: 0.123650 Jul 18 02:43:46.626313 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 494/984] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:46 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1193 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:47.642140 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8f2cd1b8-5f64-4c08-84d5-a7598899430f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:47.643370 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8f2cd1b8-5f64-4c08-84d5-a7598899430f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:47.649429 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f2cd1b8-5f64-4c08-84d5-a7598899430f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.649874 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f2cd1b8-5f64-4c08-84d5-a7598899430f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.650658 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f2cd1b8-5f64-4c08-84d5-a7598899430f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:47.651086 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8f2cd1b8-5f64-4c08-84d5-a7598899430f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:47.803733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8f2cd1b8-5f64-4c08-84d5-a7598899430f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:47.811926 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8f2cd1b8-5f64-4c08-84d5-a7598899430f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1270 microversion: 2.1 time: 0.174216 Jul 18 02:43:47.812570 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 491/985] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:47 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:48.828799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e2b3582d-3dbd-4ae4-825e-1b80d09855e9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:48.829404 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e2b3582d-3dbd-4ae4-825e-1b80d09855e9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:48.835752 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e2b3582d-3dbd-4ae4-825e-1b80d09855e9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:48.836198 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e2b3582d-3dbd-4ae4-825e-1b80d09855e9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:48.836965 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e2b3582d-3dbd-4ae4-825e-1b80d09855e9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:48.837375 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e2b3582d-3dbd-4ae4-825e-1b80d09855e9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:48.966999 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e2b3582d-3dbd-4ae4-825e-1b80d09855e9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:48.975386 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e2b3582d-3dbd-4ae4-825e-1b80d09855e9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1270 microversion: 2.1 time: 0.150553 Jul 18 02:43:48.976159 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 495/986] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:48 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:49.992902 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9703cfad-e95b-472a-ae01-6b88a5b1e335 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:49.993521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9703cfad-e95b-472a-ae01-6b88a5b1e335 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:50.000771 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9703cfad-e95b-472a-ae01-6b88a5b1e335 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:50.001223 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9703cfad-e95b-472a-ae01-6b88a5b1e335 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:50.001996 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9703cfad-e95b-472a-ae01-6b88a5b1e335 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:50.002468 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9703cfad-e95b-472a-ae01-6b88a5b1e335 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:50.132916 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9703cfad-e95b-472a-ae01-6b88a5b1e335 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:50.140338 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9703cfad-e95b-472a-ae01-6b88a5b1e335 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1270 microversion: 2.1 time: 0.151427 Jul 18 02:43:50.140910 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 492/987] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:49 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:50.587752 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-381ab035-4919-42a6-9915-197daea31f39 req-1b394e4f-ed7c-42bf-a5b3-e7f565c87443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39", "tag": "5fd8b9bf-0dc7-4030-8d82-774afb4914af"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:50.598623 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:50.605115 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-381ab035-4919-42a6-9915-197daea31f39 req-1b394e4f-ed7c-42bf-a5b3-e7f565c87443 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:50.605567 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-381ab035-4919-42a6-9915-197daea31f39 req-1b394e4f-ed7c-42bf-a5b3-e7f565c87443 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:50.622050 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-381ab035-4919-42a6-9915-197daea31f39 req-1b394e4f-ed7c-42bf-a5b3-e7f565c87443 service nova] Creating event network-changed:5fd8b9bf-0dc7-4030-8d82-774afb4914af for instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 on hv-cinder-85001 Jul 18 02:43:50.627308 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-381ab035-4919-42a6-9915-197daea31f39 req-1b394e4f-ed7c-42bf-a5b3-e7f565c87443 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043735 Jul 18 02:43:50.627974 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 496/988] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:43:51.157471 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d9457b86-42d9-4982-b26d-5a61711b463c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:51.158210 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d9457b86-42d9-4982-b26d-5a61711b463c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:51.164790 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d9457b86-42d9-4982-b26d-5a61711b463c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:51.165242 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d9457b86-42d9-4982-b26d-5a61711b463c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:51.166116 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d9457b86-42d9-4982-b26d-5a61711b463c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:51.166468 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d9457b86-42d9-4982-b26d-5a61711b463c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:51.305282 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d9457b86-42d9-4982-b26d-5a61711b463c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:51.313784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d9457b86-42d9-4982-b26d-5a61711b463c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1270 microversion: 2.1 time: 0.160417 Jul 18 02:43:51.314690 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 493/989] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:51 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:52.328277 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=8 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:52.333301 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a04aca72-ab78-4358-a359-a71c6d028bf4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:52.334012 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a04aca72-ab78-4358-a359-a71c6d028bf4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:52.340264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a04aca72-ab78-4358-a359-a71c6d028bf4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.340721 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a04aca72-ab78-4358-a359-a71c6d028bf4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:52.341653 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a04aca72-ab78-4358-a359-a71c6d028bf4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:52.341934 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a04aca72-ab78-4358-a359-a71c6d028bf4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:52.480305 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a04aca72-ab78-4358-a359-a71c6d028bf4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:52.488215 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a04aca72-ab78-4358-a359-a71c6d028bf4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1258 microversion: 2.1 time: 0.162077 Jul 18 02:43:52.488786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 497/990] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:52 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:53.505331 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-815ebf63-85e7-4c02-ae41-5fdb042469b5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:53.505941 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-815ebf63-85e7-4c02-ae41-5fdb042469b5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:53.508275 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=4 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:53.513067 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-815ebf63-85e7-4c02-ae41-5fdb042469b5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:53.513516 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-815ebf63-85e7-4c02-ae41-5fdb042469b5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:53.516831 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-815ebf63-85e7-4c02-ae41-5fdb042469b5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:53.516831 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-815ebf63-85e7-4c02-ae41-5fdb042469b5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:53.651253 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-815ebf63-85e7-4c02-ae41-5fdb042469b5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:53.663077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-815ebf63-85e7-4c02-ae41-5fdb042469b5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1258 microversion: 2.1 time: 0.161763 Jul 18 02:43:53.663719 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 494/991] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:53 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:54.680644 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2b183e20-8316-40f3-b4af-d0b8232c168b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:54.681468 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2b183e20-8316-40f3-b4af-d0b8232c168b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:54.696953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b183e20-8316-40f3-b4af-d0b8232c168b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.696953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b183e20-8316-40f3-b4af-d0b8232c168b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:54.696953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b183e20-8316-40f3-b4af-d0b8232c168b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:54.696953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b183e20-8316-40f3-b4af-d0b8232c168b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:54.756033 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1866454467", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-530523020", "security_groups": [{"name": "tempest-secgroup-smoke-1668344787"}], "block_device_mapping_v2": [{"uuid": "d4b27f57-08b2-4736-a2b9-ef805d939aa2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "40df86f1-859f-4d28-af05-d94fe8d1d2ea"}]}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:43:54.840707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-2b183e20-8316-40f3-b4af-d0b8232c168b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:54.848591 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2b183e20-8316-40f3-b4af-d0b8232c168b tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1258 microversion: 2.1 time: 0.172052 Jul 18 02:43:54.849369 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 498/992] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:54 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:54.881769 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.network.neutron [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] validate_networks() for [('40df86f1-859f-4d28-af05-d94fe8d1d2ea', None, None, None, None, None)] {{(pid=124890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:43:55.259041 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Flavor limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:43:55.259527 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Image limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:43:55.259995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Flavor pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:43:55.260465 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Image pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:43:55.260872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:43:55.270734 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:55.271180 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.271968 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:55.272398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.289218 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Getting quotas for project 807f88779cf842f3bbe09615d470f44c. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:43:55.293178 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Getting quotas for user 41a452eca3af46b09f56a80fa8652247 and project 807f88779cf842f3bbe09615d470f44c. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:43:55.351450 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Going to run 1 instances... {{(pid=124890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:43:55.355269 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4b27f57-08b2-4736-a2b9-ef805d939aa2',volume_size=None,volume_type=None)] {{(pid=124890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:43:55.803776 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c5409535-83ef-4a0e-9fc5-58a82cbb1e76 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.051446 Jul 18 02:43:55.809531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 495/993] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:43:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 02:43:55.816109 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-697f6211-b07b-4883-835d-d2189ea24811 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:55.816708 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-697f6211-b07b-4883-835d-d2189ea24811 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:55.864993 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-87abf277-a34f-4a67-b7d6-a8a9181bbca5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:55.865619 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-87abf277-a34f-4a67-b7d6-a8a9181bbca5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:55.876206 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-87abf277-a34f-4a67-b7d6-a8a9181bbca5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:55.876720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-87abf277-a34f-4a67-b7d6-a8a9181bbca5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.877570 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-87abf277-a34f-4a67-b7d6-a8a9181bbca5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:55.878244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-87abf277-a34f-4a67-b7d6-a8a9181bbca5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:55.902162 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-697f6211-b07b-4883-835d-d2189ea24811 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:55.914799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-697f6211-b07b-4883-835d-d2189ea24811 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1094 microversion: 2.1 time: 0.102813 Jul 18 02:43:55.915463 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 499/994] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:55 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1094 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:56.041384 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-87abf277-a34f-4a67-b7d6-a8a9181bbca5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:56.050319 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-87abf277-a34f-4a67-b7d6-a8a9181bbca5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1258 microversion: 2.1 time: 0.189313 Jul 18 02:43:56.050893 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 496/995] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:55 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:43:56.932734 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8fc69693-5546-4986-b397-520625f878f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:56.933346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8fc69693-5546-4986-b397-520625f878f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:56.941503 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8fc69693-5546-4986-b397-520625f878f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:56.941900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8fc69693-5546-4986-b397-520625f878f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:56.942699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8fc69693-5546-4986-b397-520625f878f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:56.943422 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8fc69693-5546-4986-b397-520625f878f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.011433 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8fc69693-5546-4986-b397-520625f878f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:57.019434 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8fc69693-5546-4986-b397-520625f878f5 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1144 microversion: 2.1 time: 0.090513 Jul 18 02:43:57.020009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 500/996] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:56 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:57.067122 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-023403c9-cdae-44a8-97c1-24bb950fb9bb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:57.068546 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-023403c9-cdae-44a8-97c1-24bb950fb9bb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:57.077806 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-023403c9-cdae-44a8-97c1-24bb950fb9bb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.078351 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-023403c9-cdae-44a8-97c1-24bb950fb9bb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.079097 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-023403c9-cdae-44a8-97c1-24bb950fb9bb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:57.079535 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-023403c9-cdae-44a8-97c1-24bb950fb9bb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:57.231647 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-023403c9-cdae-44a8-97c1-24bb950fb9bb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:57.244977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-023403c9-cdae-44a8-97c1-24bb950fb9bb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1258 microversion: 2.1 time: 0.178788 Jul 18 02:43:57.244977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 497/997] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:57 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:58.041347 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2f4d3d1e-6c2e-4578-8915-6087f6c6af48 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:58.041991 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2f4d3d1e-6c2e-4578-8915-6087f6c6af48 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:58.049355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2f4d3d1e-6c2e-4578-8915-6087f6c6af48 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.049916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2f4d3d1e-6c2e-4578-8915-6087f6c6af48 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.050842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2f4d3d1e-6c2e-4578-8915-6087f6c6af48 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.051293 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2f4d3d1e-6c2e-4578-8915-6087f6c6af48 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.115149 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-2f4d3d1e-6c2e-4578-8915-6087f6c6af48 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:58.122543 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2f4d3d1e-6c2e-4578-8915-6087f6c6af48 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1192 microversion: 2.1 time: 0.085147 Jul 18 02:43:58.123352 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 501/998] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:58 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:58.259344 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-957cabd3-c9bc-4f80-a578-e3ec64884230 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:58.259956 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-957cabd3-c9bc-4f80-a578-e3ec64884230 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:58.267205 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-957cabd3-c9bc-4f80-a578-e3ec64884230 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.267657 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-957cabd3-c9bc-4f80-a578-e3ec64884230 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.268422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-957cabd3-c9bc-4f80-a578-e3ec64884230 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:58.269235 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-957cabd3-c9bc-4f80-a578-e3ec64884230 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:58.471684 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-957cabd3-c9bc-4f80-a578-e3ec64884230 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:58.481223 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-957cabd3-c9bc-4f80-a578-e3ec64884230 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1258 microversion: 2.1 time: 0.225680 Jul 18 02:43:58.493605 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 498/999] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:58 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:59.140521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-12a90d38-de3e-4958-8767-cd0e1565f5a3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:59.141848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-12a90d38-de3e-4958-8767-cd0e1565f5a3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:59.151794 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-12a90d38-de3e-4958-8767-cd0e1565f5a3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.152728 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-12a90d38-de3e-4958-8767-cd0e1565f5a3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.154133 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-12a90d38-de3e-4958-8767-cd0e1565f5a3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.155901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-12a90d38-de3e-4958-8767-cd0e1565f5a3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.232977 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-12a90d38-de3e-4958-8767-cd0e1565f5a3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:59.240395 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-12a90d38-de3e-4958-8767-cd0e1565f5a3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1210 microversion: 2.1 time: 0.104543 Jul 18 02:43:59.240956 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 502/1000] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:59 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:43:59.502405 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-37616f3b-baf1-4d64-9985-e1a0853ecf7c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:43:59.503179 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-37616f3b-baf1-4d64-9985-e1a0853ecf7c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:43:59.512024 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-37616f3b-baf1-4d64-9985-e1a0853ecf7c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.512787 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-37616f3b-baf1-4d64-9985-e1a0853ecf7c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.514837 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-37616f3b-baf1-4d64-9985-e1a0853ecf7c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:43:59.515576 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-37616f3b-baf1-4d64-9985-e1a0853ecf7c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:43:59.757255 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-37616f3b-baf1-4d64-9985-e1a0853ecf7c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:43:59.779437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-37616f3b-baf1-4d64-9985-e1a0853ecf7c tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1258 microversion: 2.1 time: 0.282133 Jul 18 02:43:59.800799 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 499/1001] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:43:59 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1258 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:00.269202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-00769839-430b-47bc-93b2-f4b7dfff8b4b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:00.270368 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-00769839-430b-47bc-93b2-f4b7dfff8b4b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:00.284972 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00769839-430b-47bc-93b2-f4b7dfff8b4b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:00.285526 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00769839-430b-47bc-93b2-f4b7dfff8b4b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:00.286398 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00769839-430b-47bc-93b2-f4b7dfff8b4b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:00.286900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-00769839-430b-47bc-93b2-f4b7dfff8b4b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:00.491040 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-00769839-430b-47bc-93b2-f4b7dfff8b4b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:00.499224 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-00769839-430b-47bc-93b2-f4b7dfff8b4b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1278 microversion: 2.1 time: 0.237849 Jul 18 02:44:00.503252 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 503/1002] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:00 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:00.802268 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a0554d66-200c-42e2-b1e6-36a132fb3561 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:00.803085 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a0554d66-200c-42e2-b1e6-36a132fb3561 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:00.817483 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a0554d66-200c-42e2-b1e6-36a132fb3561 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:00.817977 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a0554d66-200c-42e2-b1e6-36a132fb3561 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:00.819957 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a0554d66-200c-42e2-b1e6-36a132fb3561 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:00.820428 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a0554d66-200c-42e2-b1e6-36a132fb3561 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:00.996984 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-2fa94bf9-bf6f-469a-9315-fb8b2c4789ab req-1a9ab8e1-7a1b-4cb3-be01-eaa5e486fe45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef000cad-4622-4a4d-883f-58fafad96e81", "tag": "5d5f39d1-25cc-45c5-98de-5bdf6d03c941"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:01.010840 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-2fa94bf9-bf6f-469a-9315-fb8b2c4789ab req-1a9ab8e1-7a1b-4cb3-be01-eaa5e486fe45 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.011310 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-2fa94bf9-bf6f-469a-9315-fb8b2c4789ab req-1a9ab8e1-7a1b-4cb3-be01-eaa5e486fe45 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.020730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a0554d66-200c-42e2-b1e6-36a132fb3561 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:01.032663 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a0554d66-200c-42e2-b1e6-36a132fb3561 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1258 microversion: 2.1 time: 0.235035 Jul 18 02:44:01.033961 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 500/1003] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:00 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:01.036614 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-2fa94bf9-bf6f-469a-9315-fb8b2c4789ab req-1a9ab8e1-7a1b-4cb3-be01-eaa5e486fe45 service nova] Creating event network-changed:5d5f39d1-25cc-45c5-98de-5bdf6d03c941 for instance ef000cad-4622-4a4d-883f-58fafad96e81 on hv-cinder-85001 Jul 18 02:44:01.042793 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-2fa94bf9-bf6f-469a-9315-fb8b2c4789ab req-1a9ab8e1-7a1b-4cb3-be01-eaa5e486fe45 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049157 Jul 18 02:44:01.043639 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 504/1004] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:44:01.517536 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5d99ddd5-b009-49f3-bcc6-750cb3d21c16 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:01.518757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-5d99ddd5-b009-49f3-bcc6-750cb3d21c16 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:01.525163 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5d99ddd5-b009-49f3-bcc6-750cb3d21c16 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.530241 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5d99ddd5-b009-49f3-bcc6-750cb3d21c16 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.530241 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5d99ddd5-b009-49f3-bcc6-750cb3d21c16 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:01.530241 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5d99ddd5-b009-49f3-bcc6-750cb3d21c16 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:01.666843 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5d99ddd5-b009-49f3-bcc6-750cb3d21c16 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:01.674717 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5d99ddd5-b009-49f3-bcc6-750cb3d21c16 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1266 microversion: 2.1 time: 0.161910 Jul 18 02:44:01.675289 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 501/1005] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:01 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:01.996682 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1493917764", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "networks": [{"uuid": "c8e0fb7c-2761-451c-afcc-c07dac4a49ac"}]}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:02.050789 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9b80fbf9-24da-4a4f-98ad-675de72d9205 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:02.052023 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9b80fbf9-24da-4a4f-98ad-675de72d9205 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:02.052942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] validate_networks() for [('c8e0fb7c-2761-451c-afcc-c07dac4a49ac', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:44:02.058915 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b80fbf9-24da-4a4f-98ad-675de72d9205 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.059579 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b80fbf9-24da-4a4f-98ad-675de72d9205 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.060528 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b80fbf9-24da-4a4f-98ad-675de72d9205 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.062402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9b80fbf9-24da-4a4f-98ad-675de72d9205 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.214584 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9b80fbf9-24da-4a4f-98ad-675de72d9205 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.224044 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9b80fbf9-24da-4a4f-98ad-675de72d9205 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1258 microversion: 2.1 time: 0.177803 Jul 18 02:44:02.224554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 502/1006] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:02 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:02.229713 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-b0d4301c-aec9-47dc-b195-7e8386b9a7f9 req-a8ffab06-d4f0-4b51-baf8-7dd0f6f6d8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39", "name": "network-vif-plugged", "status": "completed", "tag": "5fd8b9bf-0dc7-4030-8d82-774afb4914af"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:02.239057 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-b0d4301c-aec9-47dc-b195-7e8386b9a7f9 req-a8ffab06-d4f0-4b51-baf8-7dd0f6f6d8af service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.239969 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-b0d4301c-aec9-47dc-b195-7e8386b9a7f9 req-a8ffab06-d4f0-4b51-baf8-7dd0f6f6d8af service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.252690 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-b0d4301c-aec9-47dc-b195-7e8386b9a7f9 req-a8ffab06-d4f0-4b51-baf8-7dd0f6f6d8af service nova] Creating event network-vif-plugged:5fd8b9bf-0dc7-4030-8d82-774afb4914af for instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 on hv-cinder-85001 Jul 18 02:44:02.258889 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-b0d4301c-aec9-47dc-b195-7e8386b9a7f9 req-a8ffab06-d4f0-4b51-baf8-7dd0f6f6d8af service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032839 Jul 18 02:44:02.259555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 503/1007] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:02.463717 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:44:02.465940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:44:02.465940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:44:02.465940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:44:02.465940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:44:02.476795 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.477163 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.478000 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.478476 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.498578 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Getting quotas for project ad2b132c879f4f5e90593713a3f472c1. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:44:02.502794 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Getting quotas for user b065087a79524114b5cacb8c5fd3254f and project ad2b132c879f4f5e90593713a3f472c1. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:44:02.514504 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:44:02.516883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:44:02.692510 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8182ef14-5401-41f8-9089-50b01e60ae42 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:02.693237 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8182ef14-5401-41f8-9089-50b01e60ae42 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:02.699676 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8182ef14-5401-41f8-9089-50b01e60ae42 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.700185 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8182ef14-5401-41f8-9089-50b01e60ae42 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.701054 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8182ef14-5401-41f8-9089-50b01e60ae42 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:02.702204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8182ef14-5401-41f8-9089-50b01e60ae42 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:02.793957 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ea0f7a3a-2c27-41da-833f-04b8d91909e4 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802256 Jul 18 02:44:02.794699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 505/1008] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:44:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:44:02.805694 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9d6b3e00-d645-47fc-9e62-fabce6441aee tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:02.806425 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9d6b3e00-d645-47fc-9e62-fabce6441aee tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:02.866803 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-9d6b3e00-d645-47fc-9e62-fabce6441aee tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.875903 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9d6b3e00-d645-47fc-9e62-fabce6441aee tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1219 microversion: 2.1 time: 0.074462 Jul 18 02:44:02.883119 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 506/1009] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:02 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:02.905819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8182ef14-5401-41f8-9089-50b01e60ae42 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:02.913678 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8182ef14-5401-41f8-9089-50b01e60ae42 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1266 microversion: 2.1 time: 0.225793 Jul 18 02:44:02.914287 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 504/1010] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:02 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:03.241230 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-dbf1313f-c54e-42c6-b70d-e5015d0edab3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:03.241843 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-dbf1313f-c54e-42c6-b70d-e5015d0edab3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:03.249056 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dbf1313f-c54e-42c6-b70d-e5015d0edab3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.249506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dbf1313f-c54e-42c6-b70d-e5015d0edab3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.250308 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dbf1313f-c54e-42c6-b70d-e5015d0edab3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.250751 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dbf1313f-c54e-42c6-b70d-e5015d0edab3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.386523 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-dbf1313f-c54e-42c6-b70d-e5015d0edab3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:03.395886 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-dbf1313f-c54e-42c6-b70d-e5015d0edab3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1258 microversion: 2.1 time: 0.158459 Jul 18 02:44:03.396541 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 507/1011] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:03 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:03.893505 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e0b1852f-a78c-4a03-b59f-964256b6d40b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:03.894110 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e0b1852f-a78c-4a03-b59f-964256b6d40b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:03.931156 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3592d93a-9bfa-42f0-9e2a-aeb5e3561e04 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:03.931907 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3592d93a-9bfa-42f0-9e2a-aeb5e3561e04 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:03.939507 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3592d93a-9bfa-42f0-9e2a-aeb5e3561e04 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.939970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3592d93a-9bfa-42f0-9e2a-aeb5e3561e04 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.941427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3592d93a-9bfa-42f0-9e2a-aeb5e3561e04 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:03.941978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3592d93a-9bfa-42f0-9e2a-aeb5e3561e04 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:03.966455 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e0b1852f-a78c-4a03-b59f-964256b6d40b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:03.975188 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e0b1852f-a78c-4a03-b59f-964256b6d40b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1219 microversion: 2.1 time: 0.086246 Jul 18 02:44:03.975775 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 505/1012] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:03 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:04.096412 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3592d93a-9bfa-42f0-9e2a-aeb5e3561e04 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:04.104972 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3592d93a-9bfa-42f0-9e2a-aeb5e3561e04 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1266 microversion: 2.1 time: 0.178273 Jul 18 02:44:04.105545 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 508/1013] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:03 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:04.412803 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-dc579dca-73d6-4700-b98e-215456b7a3e4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:04.413417 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-dc579dca-73d6-4700-b98e-215456b7a3e4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:04.419427 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dc579dca-73d6-4700-b98e-215456b7a3e4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:04.419879 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dc579dca-73d6-4700-b98e-215456b7a3e4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.420665 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dc579dca-73d6-4700-b98e-215456b7a3e4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:04.421723 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dc579dca-73d6-4700-b98e-215456b7a3e4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.616827 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dc579dca-73d6-4700-b98e-215456b7a3e4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:04.624727 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-dc579dca-73d6-4700-b98e-215456b7a3e4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1442 microversion: 2.1 time: 0.215798 Jul 18 02:44:04.625304 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 506/1014] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:04 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1442 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:04.640800 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ec9788b8-5f6e-4965-b469-a1988640000f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:04.641389 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ec9788b8-5f6e-4965-b469-a1988640000f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:04.648012 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec9788b8-5f6e-4965-b469-a1988640000f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:04.648455 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec9788b8-5f6e-4965-b469-a1988640000f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.649213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec9788b8-5f6e-4965-b469-a1988640000f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:04.649642 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ec9788b8-5f6e-4965-b469-a1988640000f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:04.792612 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ec9788b8-5f6e-4965-b469-a1988640000f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:04.801719 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ec9788b8-5f6e-4965-b469-a1988640000f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1442 microversion: 2.1 time: 0.164740 Jul 18 02:44:04.802787 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 509/1015] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:04 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:04.994117 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-66aec4ff-9aac-49f3-921d-dc2f8971d961 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:04.994752 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-66aec4ff-9aac-49f3-921d-dc2f8971d961 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:05.002198 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-66aec4ff-9aac-49f3-921d-dc2f8971d961 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.002653 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-66aec4ff-9aac-49f3-921d-dc2f8971d961 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.003423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-66aec4ff-9aac-49f3-921d-dc2f8971d961 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.003860 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-66aec4ff-9aac-49f3-921d-dc2f8971d961 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.078550 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-66aec4ff-9aac-49f3-921d-dc2f8971d961 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:05.086322 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-66aec4ff-9aac-49f3-921d-dc2f8971d961 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1271 microversion: 2.1 time: 0.097258 Jul 18 02:44:05.086960 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 507/1016] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:04 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:05.122497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e7ef4630-f18c-4767-906b-dcad447fc4b3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:05.123107 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e7ef4630-f18c-4767-906b-dcad447fc4b3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:05.129262 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e7ef4630-f18c-4767-906b-dcad447fc4b3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.129711 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e7ef4630-f18c-4767-906b-dcad447fc4b3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.130503 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e7ef4630-f18c-4767-906b-dcad447fc4b3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:05.130931 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e7ef4630-f18c-4767-906b-dcad447fc4b3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:05.538075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e7ef4630-f18c-4767-906b-dcad447fc4b3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:05.548799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e7ef4630-f18c-4767-906b-dcad447fc4b3 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1266 microversion: 2.1 time: 0.426818 Jul 18 02:44:05.548799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 510/1017] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:05 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:06.104038 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cc7062cb-8e7e-49b0-a60b-c3d9c399cf8e tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:06.104677 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cc7062cb-8e7e-49b0-a60b-c3d9c399cf8e tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:06.106700 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=2 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:06.112679 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc7062cb-8e7e-49b0-a60b-c3d9c399cf8e tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:06.113133 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc7062cb-8e7e-49b0-a60b-c3d9c399cf8e tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.113909 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc7062cb-8e7e-49b0-a60b-c3d9c399cf8e tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:06.114368 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cc7062cb-8e7e-49b0-a60b-c3d9c399cf8e tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.180732 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cc7062cb-8e7e-49b0-a60b-c3d9c399cf8e tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.184170 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:06.188775 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cc7062cb-8e7e-49b0-a60b-c3d9c399cf8e tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1277 microversion: 2.1 time: 0.088646 Jul 18 02:44:06.189603 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 508/1018] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:06 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:06.562358 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-61fce3ce-2748-4aab-a151-78312a1cce58 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:06.563362 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-61fce3ce-2748-4aab-a151-78312a1cce58 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:06.570728 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-61fce3ce-2748-4aab-a151-78312a1cce58 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:06.571304 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-61fce3ce-2748-4aab-a151-78312a1cce58 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.572153 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-61fce3ce-2748-4aab-a151-78312a1cce58 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:06.572664 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-61fce3ce-2748-4aab-a151-78312a1cce58 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:06.828328 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-61fce3ce-2748-4aab-a151-78312a1cce58 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:06.836742 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-61fce3ce-2748-4aab-a151-78312a1cce58 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1266 microversion: 2.1 time: 0.278354 Jul 18 02:44:06.837511 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 511/1019] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:06 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:07.208836 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-4824a386-61ab-4a81-9992-a2851d2bbda0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:07.209511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-4824a386-61ab-4a81-9992-a2851d2bbda0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:07.216704 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4824a386-61ab-4a81-9992-a2851d2bbda0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.217160 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4824a386-61ab-4a81-9992-a2851d2bbda0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.218620 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4824a386-61ab-4a81-9992-a2851d2bbda0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.219123 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-4824a386-61ab-4a81-9992-a2851d2bbda0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.409617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-4824a386-61ab-4a81-9992-a2851d2bbda0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:07.418317 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-4824a386-61ab-4a81-9992-a2851d2bbda0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1319 microversion: 2.1 time: 0.213575 Jul 18 02:44:07.419213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 509/1020] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:07 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:07.853726 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e2ecd385-d48c-45dc-85f3-9d84494d647a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:07.854389 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e2ecd385-d48c-45dc-85f3-9d84494d647a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:07.861297 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e2ecd385-d48c-45dc-85f3-9d84494d647a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.861753 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e2ecd385-d48c-45dc-85f3-9d84494d647a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:07.862792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e2ecd385-d48c-45dc-85f3-9d84494d647a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:07.863319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e2ecd385-d48c-45dc-85f3-9d84494d647a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:08.225508 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e2ecd385-d48c-45dc-85f3-9d84494d647a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:08.233095 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e2ecd385-d48c-45dc-85f3-9d84494d647a tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1266 microversion: 2.1 time: 0.383955 Jul 18 02:44:08.234334 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 512/1021] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:07 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1266 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:08.435712 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2a3ef409-8c8a-4ebf-85a4-2c243f576af5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:08.436335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2a3ef409-8c8a-4ebf-85a4-2c243f576af5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:08.443607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a3ef409-8c8a-4ebf-85a4-2c243f576af5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:08.443935 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a3ef409-8c8a-4ebf-85a4-2c243f576af5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:08.444714 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a3ef409-8c8a-4ebf-85a4-2c243f576af5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:08.445154 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2a3ef409-8c8a-4ebf-85a4-2c243f576af5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:08.582870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2a3ef409-8c8a-4ebf-85a4-2c243f576af5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:08.590538 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2a3ef409-8c8a-4ebf-85a4-2c243f576af5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1319 microversion: 2.1 time: 0.158695 Jul 18 02:44:08.591116 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 510/1022] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:08 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:08.916517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-734cc327-c985-4547-903d-610725f4d1df req-fc5d79ba-ead8-4d85-be85-beb9e40c5c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39", "tag": "5fd8b9bf-0dc7-4030-8d82-774afb4914af"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:08.925826 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-734cc327-c985-4547-903d-610725f4d1df req-fc5d79ba-ead8-4d85-be85-beb9e40c5c52 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:08.926341 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-734cc327-c985-4547-903d-610725f4d1df req-fc5d79ba-ead8-4d85-be85-beb9e40c5c52 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:08.930306 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=100 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:08.938174 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-734cc327-c985-4547-903d-610725f4d1df req-fc5d79ba-ead8-4d85-be85-beb9e40c5c52 service nova] Creating event network-changed:5fd8b9bf-0dc7-4030-8d82-774afb4914af for instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 on hv-cinder-85001 Jul 18 02:44:08.944043 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-734cc327-c985-4547-903d-610725f4d1df req-fc5d79ba-ead8-4d85-be85-beb9e40c5c52 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031622 Jul 18 02:44:08.944868 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 513/1023] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:09.250199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a07b86f6-0f49-4d29-a73a-7b6400c60d7d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:09.250815 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a07b86f6-0f49-4d29-a73a-7b6400c60d7d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:09.258888 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a07b86f6-0f49-4d29-a73a-7b6400c60d7d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.259340 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a07b86f6-0f49-4d29-a73a-7b6400c60d7d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.260376 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a07b86f6-0f49-4d29-a73a-7b6400c60d7d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.260812 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a07b86f6-0f49-4d29-a73a-7b6400c60d7d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.419825 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a07b86f6-0f49-4d29-a73a-7b6400c60d7d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:09.428975 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a07b86f6-0f49-4d29-a73a-7b6400c60d7d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1266 microversion: 2.1 time: 0.182487 Jul 18 02:44:09.429874 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 511/1024] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:09 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:09.617358 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-af5e8c85-7955-48b1-a4b2-e1af63be9878 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:09.618063 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-af5e8c85-7955-48b1-a4b2-e1af63be9878 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:09.625627 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-af5e8c85-7955-48b1-a4b2-e1af63be9878 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.626074 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-af5e8c85-7955-48b1-a4b2-e1af63be9878 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.626870 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-af5e8c85-7955-48b1-a4b2-e1af63be9878 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:09.627417 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-af5e8c85-7955-48b1-a4b2-e1af63be9878 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:09.884838 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-af5e8c85-7955-48b1-a4b2-e1af63be9878 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:09.901561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-af5e8c85-7955-48b1-a4b2-e1af63be9878 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1319 microversion: 2.1 time: 0.288446 Jul 18 02:44:09.902172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 514/1025] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:09 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:10.446038 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f328b1ac-de08-4337-9825-72972f69fcfc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:10.446686 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f328b1ac-de08-4337-9825-72972f69fcfc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:10.453820 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f328b1ac-de08-4337-9825-72972f69fcfc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:10.454299 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f328b1ac-de08-4337-9825-72972f69fcfc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:10.455064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f328b1ac-de08-4337-9825-72972f69fcfc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:10.455497 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f328b1ac-de08-4337-9825-72972f69fcfc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:10.591872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f328b1ac-de08-4337-9825-72972f69fcfc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:10.600048 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f328b1ac-de08-4337-9825-72972f69fcfc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1266 microversion: 2.1 time: 0.157674 Jul 18 02:44:10.600534 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 512/1026] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:10 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:10.919473 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-13b20c66-64cb-4752-af83-5f4423601a15 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:10.920088 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-13b20c66-64cb-4752-af83-5f4423601a15 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:10.923093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:10.927966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-13b20c66-64cb-4752-af83-5f4423601a15 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:10.928433 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-13b20c66-64cb-4752-af83-5f4423601a15 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:10.929235 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-13b20c66-64cb-4752-af83-5f4423601a15 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:10.929677 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-13b20c66-64cb-4752-af83-5f4423601a15 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:10.962111 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-27f8bff6-638f-4c38-ac2e-0a04db16ce5c req-b892c662-1090-4337-b483-a2fe39485dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a428e59c-6b34-4387-83d1-1d719eef2abf", "tag": "d0204ed9-f9ee-4893-b615-fad157df027c"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:10.970618 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-27f8bff6-638f-4c38-ac2e-0a04db16ce5c req-b892c662-1090-4337-b483-a2fe39485dd6 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:10.971063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-27f8bff6-638f-4c38-ac2e-0a04db16ce5c req-b892c662-1090-4337-b483-a2fe39485dd6 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:10.982455 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-27f8bff6-638f-4c38-ac2e-0a04db16ce5c req-b892c662-1090-4337-b483-a2fe39485dd6 service nova] Creating event network-changed:d0204ed9-f9ee-4893-b615-fad157df027c for instance a428e59c-6b34-4387-83d1-1d719eef2abf on hv-cinder-85001 Jul 18 02:44:10.988137 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-27f8bff6-638f-4c38-ac2e-0a04db16ce5c req-b892c662-1090-4337-b483-a2fe39485dd6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029697 Jul 18 02:44:10.988733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 513/1027] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:44:11.066561 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-13b20c66-64cb-4752-af83-5f4423601a15 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:11.073759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-13b20c66-64cb-4752-af83-5f4423601a15 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1319 microversion: 2.1 time: 0.158278 Jul 18 02:44:11.074371 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 515/1028] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:10 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:11.618219 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1b1c18bb-5ecc-4026-806d-3cf1dad456a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:11.618924 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1b1c18bb-5ecc-4026-806d-3cf1dad456a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:11.620952 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:11.626239 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1b1c18bb-5ecc-4026-806d-3cf1dad456a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.626700 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1b1c18bb-5ecc-4026-806d-3cf1dad456a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.627474 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1b1c18bb-5ecc-4026-806d-3cf1dad456a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:11.627911 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1b1c18bb-5ecc-4026-806d-3cf1dad456a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:11.771295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1b1c18bb-5ecc-4026-806d-3cf1dad456a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:11.778849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1b1c18bb-5ecc-4026-806d-3cf1dad456a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1266 microversion: 2.1 time: 0.165572 Jul 18 02:44:11.779434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 514/1029] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:11 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:12.090950 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-0012d3cb-c3a5-41bb-be5d-3689c1360b40 req-63e4f475-af3d-4193-88c8-07b77ba72b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef000cad-4622-4a4d-883f-58fafad96e81", "name": "network-vif-plugged", "status": "completed", "tag": "5d5f39d1-25cc-45c5-98de-5bdf6d03c941"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:12.091202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c45f2a51-446d-4b96-beab-c479857b0d5f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:12.091729 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c45f2a51-446d-4b96-beab-c479857b0d5f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:12.100101 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c45f2a51-446d-4b96-beab-c479857b0d5f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.101003 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-0012d3cb-c3a5-41bb-be5d-3689c1360b40 req-63e4f475-af3d-4193-88c8-07b77ba72b9d service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.101134 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c45f2a51-446d-4b96-beab-c479857b0d5f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.101245 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-0012d3cb-c3a5-41bb-be5d-3689c1360b40 req-63e4f475-af3d-4193-88c8-07b77ba72b9d service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.101633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c45f2a51-446d-4b96-beab-c479857b0d5f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.102185 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c45f2a51-446d-4b96-beab-c479857b0d5f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.112474 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-0012d3cb-c3a5-41bb-be5d-3689c1360b40 req-63e4f475-af3d-4193-88c8-07b77ba72b9d service nova] Creating event network-vif-plugged:5d5f39d1-25cc-45c5-98de-5bdf6d03c941 for instance ef000cad-4622-4a4d-883f-58fafad96e81 on hv-cinder-85001 Jul 18 02:44:12.117491 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-0012d3cb-c3a5-41bb-be5d-3689c1360b40 req-63e4f475-af3d-4193-88c8-07b77ba72b9d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030418 Jul 18 02:44:12.118192 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 515/1030] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:12.239722 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c45f2a51-446d-4b96-beab-c479857b0d5f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:12.247338 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c45f2a51-446d-4b96-beab-c479857b0d5f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1319 microversion: 2.1 time: 0.160533 Jul 18 02:44:12.251964 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 516/1031] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:12 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:12.797369 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-98294fd4-e473-4317-888b-522b51e5d257 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:12.798134 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-98294fd4-e473-4317-888b-522b51e5d257 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:12.804974 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98294fd4-e473-4317-888b-522b51e5d257 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.805431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98294fd4-e473-4317-888b-522b51e5d257 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.806238 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98294fd4-e473-4317-888b-522b51e5d257 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:12.806684 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-98294fd4-e473-4317-888b-522b51e5d257 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:12.940253 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-98294fd4-e473-4317-888b-522b51e5d257 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:12.948160 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-98294fd4-e473-4317-888b-522b51e5d257 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1266 microversion: 2.1 time: 0.155515 Jul 18 02:44:12.948733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 516/1032] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:12 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:13.264906 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ce8fbc68-ebd5-44a2-ba5f-b1cdce35f21d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:13.265656 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ce8fbc68-ebd5-44a2-ba5f-b1cdce35f21d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:13.267695 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:13.268497 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=10 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:13.273799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ce8fbc68-ebd5-44a2-ba5f-b1cdce35f21d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.275884 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ce8fbc68-ebd5-44a2-ba5f-b1cdce35f21d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:13.275884 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ce8fbc68-ebd5-44a2-ba5f-b1cdce35f21d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.275884 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ce8fbc68-ebd5-44a2-ba5f-b1cdce35f21d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:13.412585 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ce8fbc68-ebd5-44a2-ba5f-b1cdce35f21d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:13.420863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ce8fbc68-ebd5-44a2-ba5f-b1cdce35f21d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1319 microversion: 2.1 time: 0.160099 Jul 18 02:44:13.421551 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 517/1033] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:13 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:13.965442 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c0438908-0ffc-4e0c-a277-82dfc49d06fe tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:13.966877 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c0438908-0ffc-4e0c-a277-82dfc49d06fe tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:13.973952 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c0438908-0ffc-4e0c-a277-82dfc49d06fe tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.974440 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c0438908-0ffc-4e0c-a277-82dfc49d06fe tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:13.975213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c0438908-0ffc-4e0c-a277-82dfc49d06fe tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:13.975648 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c0438908-0ffc-4e0c-a277-82dfc49d06fe tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:13.976189 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=8 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:14.115970 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c0438908-0ffc-4e0c-a277-82dfc49d06fe tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:14.125167 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c0438908-0ffc-4e0c-a277-82dfc49d06fe tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1453 microversion: 2.1 time: 0.163139 Jul 18 02:44:14.127007 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 517/1034] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:13 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:14.144592 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6f2d6be4-64b1-459f-92c0-329dee392e64 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:14.145419 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6f2d6be4-64b1-459f-92c0-329dee392e64 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:14.153217 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f2d6be4-64b1-459f-92c0-329dee392e64 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:14.153809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f2d6be4-64b1-459f-92c0-329dee392e64 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:14.154647 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f2d6be4-64b1-459f-92c0-329dee392e64 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:14.155099 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f2d6be4-64b1-459f-92c0-329dee392e64 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:14.438534 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-55dbfd4c-6cb2-46af-9603-9b78e06cdbc5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:14.439258 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-55dbfd4c-6cb2-46af-9603-9b78e06cdbc5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:14.446985 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-55dbfd4c-6cb2-46af-9603-9b78e06cdbc5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:14.447551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-55dbfd4c-6cb2-46af-9603-9b78e06cdbc5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:14.448409 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-55dbfd4c-6cb2-46af-9603-9b78e06cdbc5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:14.448964 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-55dbfd4c-6cb2-46af-9603-9b78e06cdbc5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:14.595594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6f2d6be4-64b1-459f-92c0-329dee392e64 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:14.604850 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6f2d6be4-64b1-459f-92c0-329dee392e64 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1453 microversion: 2.1 time: 0.465402 Jul 18 02:44:14.621364 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 518/1035] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:14 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1453 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:14.645343 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-55dbfd4c-6cb2-46af-9603-9b78e06cdbc5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:14.667412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-55dbfd4c-6cb2-46af-9603-9b78e06cdbc5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1319 microversion: 2.1 time: 0.220185 Jul 18 02:44:14.667412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 518/1036] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:14 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:44:15.681425 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a2a492bc-e10f-4b2f-b717-834317cc792f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:15.682263 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a2a492bc-e10f-4b2f-b717-834317cc792f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:15.690460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a2a492bc-e10f-4b2f-b717-834317cc792f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:15.690919 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a2a492bc-e10f-4b2f-b717-834317cc792f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:15.691709 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a2a492bc-e10f-4b2f-b717-834317cc792f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:15.692156 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a2a492bc-e10f-4b2f-b717-834317cc792f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:15.832035 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a2a492bc-e10f-4b2f-b717-834317cc792f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:15.839589 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a2a492bc-e10f-4b2f-b717-834317cc792f tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1319 microversion: 2.1 time: 0.162263 Jul 18 02:44:15.840284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 519/1037] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:15 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:16.093416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-4e540e64-57c6-47ec-81d6-b83e3108b75c req-e51cf816-3bbb-432c-9e94-57d3d8732dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a428e59c-6b34-4387-83d1-1d719eef2abf", "name": "network-vif-plugged", "status": "completed", "tag": "d0204ed9-f9ee-4893-b615-fad157df027c"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:16.105140 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-4e540e64-57c6-47ec-81d6-b83e3108b75c req-e51cf816-3bbb-432c-9e94-57d3d8732dd5 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:16.105140 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-4e540e64-57c6-47ec-81d6-b83e3108b75c req-e51cf816-3bbb-432c-9e94-57d3d8732dd5 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:16.116957 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-4e540e64-57c6-47ec-81d6-b83e3108b75c req-e51cf816-3bbb-432c-9e94-57d3d8732dd5 service nova] Creating event network-vif-plugged:d0204ed9-f9ee-4893-b615-fad157df027c for instance a428e59c-6b34-4387-83d1-1d719eef2abf on hv-cinder-85001 Jul 18 02:44:16.122553 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-4e540e64-57c6-47ec-81d6-b83e3108b75c req-e51cf816-3bbb-432c-9e94-57d3d8732dd5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032994 Jul 18 02:44:16.123258 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 519/1038] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:16.857021 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f0b30e2c-5f19-445f-bfa3-7299f8fc1b32 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:16.857641 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f0b30e2c-5f19-445f-bfa3-7299f8fc1b32 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:16.865302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b30e2c-5f19-445f-bfa3-7299f8fc1b32 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:16.865819 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b30e2c-5f19-445f-bfa3-7299f8fc1b32 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:16.866634 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b30e2c-5f19-445f-bfa3-7299f8fc1b32 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:16.867270 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f0b30e2c-5f19-445f-bfa3-7299f8fc1b32 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:17.005796 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f0b30e2c-5f19-445f-bfa3-7299f8fc1b32 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:17.025049 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-8c2b8c28-67d2-473b-9fa6-765c8cc1cdd8 req-d65df19f-d214-4ab9-a8eb-8409bc9250ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef000cad-4622-4a4d-883f-58fafad96e81", "tag": "5d5f39d1-25cc-45c5-98de-5bdf6d03c941"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:17.034248 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-8c2b8c28-67d2-473b-9fa6-765c8cc1cdd8 req-d65df19f-d214-4ab9-a8eb-8409bc9250ee service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:17.034912 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-8c2b8c28-67d2-473b-9fa6-765c8cc1cdd8 req-d65df19f-d214-4ab9-a8eb-8409bc9250ee service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:17.035587 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f0b30e2c-5f19-445f-bfa3-7299f8fc1b32 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1319 microversion: 2.1 time: 0.182578 Jul 18 02:44:17.036177 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 520/1039] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:16 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:17.047768 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-8c2b8c28-67d2-473b-9fa6-765c8cc1cdd8 req-d65df19f-d214-4ab9-a8eb-8409bc9250ee service nova] Creating event network-changed:5d5f39d1-25cc-45c5-98de-5bdf6d03c941 for instance ef000cad-4622-4a4d-883f-58fafad96e81 on hv-cinder-85001 Jul 18 02:44:17.052572 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-8c2b8c28-67d2-473b-9fa6-765c8cc1cdd8 req-d65df19f-d214-4ab9-a8eb-8409bc9250ee service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031614 Jul 18 02:44:17.053198 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 520/1040] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:18.053152 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0197567f-8b9a-4f1d-88fe-526ddbd25db7 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:18.054511 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0197567f-8b9a-4f1d-88fe-526ddbd25db7 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:18.061089 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0197567f-8b9a-4f1d-88fe-526ddbd25db7 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:18.061620 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0197567f-8b9a-4f1d-88fe-526ddbd25db7 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:18.062672 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0197567f-8b9a-4f1d-88fe-526ddbd25db7 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:18.063319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0197567f-8b9a-4f1d-88fe-526ddbd25db7 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:18.234319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0197567f-8b9a-4f1d-88fe-526ddbd25db7 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:18.240806 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0197567f-8b9a-4f1d-88fe-526ddbd25db7 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1319 microversion: 2.1 time: 0.191459 Jul 18 02:44:18.250118 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 521/1041] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:18 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:19.258374 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0a4380a1-5491-460b-bdaf-01961b2d97e2 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:19.259070 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0a4380a1-5491-460b-bdaf-01961b2d97e2 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:19.265682 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a4380a1-5491-460b-bdaf-01961b2d97e2 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:19.266148 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a4380a1-5491-460b-bdaf-01961b2d97e2 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:19.266907 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a4380a1-5491-460b-bdaf-01961b2d97e2 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:19.267344 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a4380a1-5491-460b-bdaf-01961b2d97e2 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:19.402919 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0a4380a1-5491-460b-bdaf-01961b2d97e2 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:19.410370 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0a4380a1-5491-460b-bdaf-01961b2d97e2 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1508 microversion: 2.1 time: 0.156634 Jul 18 02:44:19.410936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 521/1042] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:19 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:39.114067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9bdb3832-9ade-42a7-8bf9-c5cf210e28db tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4e9da90-62ca-4d64-a8ea-f9f011fa7c72", "device": "/dev/sdb"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:39.115750 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9bdb3832-9ade-42a7-8bf9-c5cf210e28db tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:39.118647 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=13 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:39.119321 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=48 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:39.124347 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9bdb3832-9ade-42a7-8bf9-c5cf210e28db tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:39.130306 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9bdb3832-9ade-42a7-8bf9-c5cf210e28db tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:39.130306 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9bdb3832-9ade-42a7-8bf9-c5cf210e28db tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:39.130306 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9bdb3832-9ade-42a7-8bf9-c5cf210e28db tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:40.213700 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9bdb3832-9ade-42a7-8bf9-c5cf210e28db tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "POST /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.103529 Jul 18 02:44:40.215415 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 522/1043] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:44:39 2022] POST /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf/os-volume_attachments => generated 194 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:53.532579 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8b48ade5-0119-411e-aa58-a9778092fabd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Action: 'create', calling method: .version_select at 0x7f28edf734c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-426497838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQesvAmGAELPBLLRxoQQ5qBpk27l2KNIAXpJcsqT3NzN6Ai4QmVZjmnoEt1//MIKICDfRWGtmZZkvDWUw4C8sZBlIJ93ci7dCFlAhy6x+Oaz9IgeX2Hng/LXuzCOPZ9kQ=="}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:53.536834 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=15 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:53.539470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=62 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:53.548692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-8b48ade5-0119-411e-aa58-a9778092fabd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Getting quotas for project 73679a05b6dc4583842dacfeb898876f. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:44:53.552569 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-8b48ade5-0119-411e-aa58-a9778092fabd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Getting quotas for user 3277db965cea4f23b463836d26990e1c and project 73679a05b6dc4583842dacfeb898876f. Resources: {'key_pairs'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:44:53.670329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8b48ade5-0119-411e-aa58-a9778092fabd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.141989 Jul 18 02:44:53.670926 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 522/1044] 10.222.0.66 () {60 vars in 1158 bytes} [Mon Jul 18 02:44:53 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:44:53.716205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:53.717041 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:53.721188 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-712607323", "imageRef": "bc90db5a-c761-4d73-94ac-3b01a0f01f09", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-426497838", "networks": [{"uuid": "a4798e7c-3ecb-4e02-b419-4249905e6fc3"}]}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:44:53.770372 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.network.neutron [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] validate_networks() for [('a4798e7c-3ecb-4e02-b419-4249905e6fc3', None, None, None, None, None)] {{(pid=124891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:44:54.141689 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Flavor limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:44:54.142231 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Image limits 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:44:54.146526 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Flavor pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:44:54.146526 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Image pref 0:0:0 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:44:54.146526 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.virt.hardware [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:44:54.153379 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:54.153991 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:54.154831 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:54.155270 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:54.171847 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Getting quotas for project 73679a05b6dc4583842dacfeb898876f. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:44:54.175782 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.quota [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Getting quotas for user 3277db965cea4f23b463836d26990e1c and project 73679a05b6dc4583842dacfeb898876f. Resources: {'cores', 'ram', 'instances'} {{(pid=124891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:44:54.187321 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Going to run 1 instances... {{(pid=124891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:44:54.189638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bc90db5a-c761-4d73-94ac-3b01a0f01f09',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:44:54.323338 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-93d405d8-2645-4019-85fd-74980de283e8 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608402 Jul 18 02:44:54.323904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 523/1045] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:44:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:44:54.334400 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-7eb75e8e-2be6-4e25-b353-f367c95c5e53 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:54.335672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-7eb75e8e-2be6-4e25-b353-f367c95c5e53 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:54.393327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-7eb75e8e-2be6-4e25-b353-f367c95c5e53 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:54.399753 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-7eb75e8e-2be6-4e25-b353-f367c95c5e53 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1257 microversion: 2.1 time: 0.069664 Jul 18 02:44:54.400329 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 523/1046] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:54 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:55.417363 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c894f708-bea8-43f4-863e-bffc4f5b9f61 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:55.418218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c894f708-bea8-43f4-863e-bffc4f5b9f61 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:55.472900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c894f708-bea8-43f4-863e-bffc4f5b9f61 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:55.480690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c894f708-bea8-43f4-863e-bffc4f5b9f61 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1257 microversion: 2.1 time: 0.067569 Jul 18 02:44:55.481250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 524/1047] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:55 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:56.497525 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ec656258-72b9-4511-ba00-31631bdbdd4b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:56.498124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-ec656258-72b9-4511-ba00-31631bdbdd4b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:56.504676 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ec656258-72b9-4511-ba00-31631bdbdd4b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:56.505120 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ec656258-72b9-4511-ba00-31631bdbdd4b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:56.505872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ec656258-72b9-4511-ba00-31631bdbdd4b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:56.506334 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ec656258-72b9-4511-ba00-31631bdbdd4b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:56.570575 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ec656258-72b9-4511-ba00-31631bdbdd4b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:56.577474 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ec656258-72b9-4511-ba00-31631bdbdd4b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1261 microversion: 2.1 time: 0.083970 Jul 18 02:44:56.578032 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 524/1048] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:56 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:57.594405 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f122a930-ba9b-4827-925b-a915f6decdaf tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:57.594967 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f122a930-ba9b-4827-925b-a915f6decdaf tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:57.601937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f122a930-ba9b-4827-925b-a915f6decdaf tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:57.602415 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f122a930-ba9b-4827-925b-a915f6decdaf tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:57.603198 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f122a930-ba9b-4827-925b-a915f6decdaf tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:57.605878 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f122a930-ba9b-4827-925b-a915f6decdaf tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:57.667103 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f122a930-ba9b-4827-925b-a915f6decdaf tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:57.675365 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f122a930-ba9b-4827-925b-a915f6decdaf tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1253 microversion: 2.1 time: 0.085014 Jul 18 02:44:57.675932 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 525/1049] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:57 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:58.693079 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3d520a8b-d316-4553-b07d-45a8cde9e61c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:58.693686 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3d520a8b-d316-4553-b07d-45a8cde9e61c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:58.701057 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d520a8b-d316-4553-b07d-45a8cde9e61c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:58.701514 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d520a8b-d316-4553-b07d-45a8cde9e61c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:58.702379 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d520a8b-d316-4553-b07d-45a8cde9e61c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:58.702874 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3d520a8b-d316-4553-b07d-45a8cde9e61c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:58.772751 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3d520a8b-d316-4553-b07d-45a8cde9e61c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:58.780554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3d520a8b-d316-4553-b07d-45a8cde9e61c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1327 microversion: 2.1 time: 0.091635 Jul 18 02:44:58.781267 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 525/1050] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:58 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1327 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:44:59.797867 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f2f847b6-a089-42ea-8145-607fc6bacaae tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:44:59.798515 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f2f847b6-a089-42ea-8145-607fc6bacaae tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:44:59.805039 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2f847b6-a089-42ea-8145-607fc6bacaae tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:59.807699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2f847b6-a089-42ea-8145-607fc6bacaae tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:59.807699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2f847b6-a089-42ea-8145-607fc6bacaae tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:44:59.807699 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f2f847b6-a089-42ea-8145-607fc6bacaae tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:44:59.935910 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f2f847b6-a089-42ea-8145-607fc6bacaae tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:44:59.943635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f2f847b6-a089-42ea-8145-607fc6bacaae tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.149754 Jul 18 02:44:59.944198 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 526/1051] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:44:59 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:00.961455 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5cddb269-db05-43cf-a00f-1a1ea063ec29 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:00.962116 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-5cddb269-db05-43cf-a00f-1a1ea063ec29 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:00.969321 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5cddb269-db05-43cf-a00f-1a1ea063ec29 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:00.969773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5cddb269-db05-43cf-a00f-1a1ea063ec29 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:00.975271 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5cddb269-db05-43cf-a00f-1a1ea063ec29 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:00.975271 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5cddb269-db05-43cf-a00f-1a1ea063ec29 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:01.247705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5cddb269-db05-43cf-a00f-1a1ea063ec29 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:01.254942 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5cddb269-db05-43cf-a00f-1a1ea063ec29 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.297711 Jul 18 02:45:01.255508 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 526/1052] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:00 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:02.271609 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ba5477c7-d1f0-47da-bc4e-e5172df74a0f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:02.272212 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ba5477c7-d1f0-47da-bc4e-e5172df74a0f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:02.286827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ba5477c7-d1f0-47da-bc4e-e5172df74a0f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:02.287284 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ba5477c7-d1f0-47da-bc4e-e5172df74a0f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:02.288080 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ba5477c7-d1f0-47da-bc4e-e5172df74a0f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:02.288519 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ba5477c7-d1f0-47da-bc4e-e5172df74a0f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:02.611680 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-ba5477c7-d1f0-47da-bc4e-e5172df74a0f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:02.632600 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ba5477c7-d1f0-47da-bc4e-e5172df74a0f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.364884 Jul 18 02:45:02.637084 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 527/1053] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:02 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:02.928742 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-47ecd143-d77b-4657-a160-19e6b3f2ea2b req-bed6dd8c-4a13-4128-939c-2abbc7e1f2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3640269-34ee-4261-9b14-4bcfb5e666bd", "tag": "806e3d9e-a117-4a78-af51-028fc4c0d065"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:02.949803 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-47ecd143-d77b-4657-a160-19e6b3f2ea2b req-bed6dd8c-4a13-4128-939c-2abbc7e1f2b0 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:02.951665 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-47ecd143-d77b-4657-a160-19e6b3f2ea2b req-bed6dd8c-4a13-4128-939c-2abbc7e1f2b0 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:02.996874 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-47ecd143-d77b-4657-a160-19e6b3f2ea2b req-bed6dd8c-4a13-4128-939c-2abbc7e1f2b0 service nova] Creating event network-changed:806e3d9e-a117-4a78-af51-028fc4c0d065 for instance b3640269-34ee-4261-9b14-4bcfb5e666bd on hv-cinder-85001 Jul 18 02:45:03.015996 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-47ecd143-d77b-4657-a160-19e6b3f2ea2b req-bed6dd8c-4a13-4128-939c-2abbc7e1f2b0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093931 Jul 18 02:45:03.022255 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 527/1054] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:03.655788 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b6fd45b0-17b4-46fa-b2b7-486541f55f7c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:03.657177 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b6fd45b0-17b4-46fa-b2b7-486541f55f7c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:03.665437 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6fd45b0-17b4-46fa-b2b7-486541f55f7c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:03.665963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6fd45b0-17b4-46fa-b2b7-486541f55f7c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:03.666849 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6fd45b0-17b4-46fa-b2b7-486541f55f7c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:03.668262 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6fd45b0-17b4-46fa-b2b7-486541f55f7c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:03.810206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b6fd45b0-17b4-46fa-b2b7-486541f55f7c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:03.818544 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b6fd45b0-17b4-46fa-b2b7-486541f55f7c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.167011 Jul 18 02:45:03.828179 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 528/1055] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:03 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:04.833663 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=6 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:04.838066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-05af1164-af8c-4a88-8a70-4fc543499bef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:04.838872 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-05af1164-af8c-4a88-8a70-4fc543499bef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:04.845458 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-05af1164-af8c-4a88-8a70-4fc543499bef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:04.845913 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-05af1164-af8c-4a88-8a70-4fc543499bef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:04.846709 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-05af1164-af8c-4a88-8a70-4fc543499bef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:04.847254 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-05af1164-af8c-4a88-8a70-4fc543499bef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:04.993720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-05af1164-af8c-4a88-8a70-4fc543499bef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:05.002193 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-05af1164-af8c-4a88-8a70-4fc543499bef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.170075 Jul 18 02:45:05.002781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 528/1056] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:04 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:06.019447 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e59954d9-5962-44a5-8c8f-cec55b43f5ef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:06.021264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e59954d9-5962-44a5-8c8f-cec55b43f5ef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:06.024780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:06.026449 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell0:SELECT=8 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:06.031096 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e59954d9-5962-44a5-8c8f-cec55b43f5ef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:06.031994 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e59954d9-5962-44a5-8c8f-cec55b43f5ef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:06.033020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e59954d9-5962-44a5-8c8f-cec55b43f5ef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:06.033988 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e59954d9-5962-44a5-8c8f-cec55b43f5ef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:06.218333 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e59954d9-5962-44a5-8c8f-cec55b43f5ef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:06.226260 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e59954d9-5962-44a5-8c8f-cec55b43f5ef tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.210820 Jul 18 02:45:06.226824 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 529/1057] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:06 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:07.243436 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-da632af8-ee7e-44a6-9f45-b34a09e7a3f2 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:07.244177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-da632af8-ee7e-44a6-9f45-b34a09e7a3f2 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:07.250933 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da632af8-ee7e-44a6-9f45-b34a09e7a3f2 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:07.251490 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da632af8-ee7e-44a6-9f45-b34a09e7a3f2 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:07.252309 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da632af8-ee7e-44a6-9f45-b34a09e7a3f2 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:07.252775 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da632af8-ee7e-44a6-9f45-b34a09e7a3f2 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:07.397186 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-da632af8-ee7e-44a6-9f45-b34a09e7a3f2 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:07.405826 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-da632af8-ee7e-44a6-9f45-b34a09e7a3f2 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.166335 Jul 18 02:45:07.406511 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 529/1058] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:07 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:07.649987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c059fa62-1345-4af2-841a-f883e214ce38 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:07.650558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c059fa62-1345-4af2-841a-f883e214ce38 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:07.658369 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c059fa62-1345-4af2-841a-f883e214ce38 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:07.658846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c059fa62-1345-4af2-841a-f883e214ce38 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:07.659639 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c059fa62-1345-4af2-841a-f883e214ce38 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:07.660074 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c059fa62-1345-4af2-841a-f883e214ce38 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:07.744683 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-c059fa62-1345-4af2-841a-f883e214ce38 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lazy-loading 'services' on Instance uuid a428e59c-6b34-4387-83d1-1d719eef2abf {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:45:07.990499 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c059fa62-1345-4af2-841a-f883e214ce38 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf/os-volume_attachments/b4e9da90-62ca-4d64-a8ea-f9f011fa7c72" status: 202 len: 0 microversion: 2.1 time: 0.344191 Jul 18 02:45:07.991090 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 530/1059] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:45:07 2022] DELETE /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf/os-volume_attachments/b4e9da90-62ca-4d64-a8ea-f9f011fa7c72 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:45:08.423157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-ba56e7e6-07ae-420e-b95c-3f23a7bd0d77 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:08.423810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-ba56e7e6-07ae-420e-b95c-3f23a7bd0d77 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:08.430692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ba56e7e6-07ae-420e-b95c-3f23a7bd0d77 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:08.431148 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ba56e7e6-07ae-420e-b95c-3f23a7bd0d77 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:08.431928 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ba56e7e6-07ae-420e-b95c-3f23a7bd0d77 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:08.432365 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-ba56e7e6-07ae-420e-b95c-3f23a7bd0d77 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:08.582117 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-ba56e7e6-07ae-420e-b95c-3f23a7bd0d77 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:08.590910 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-ba56e7e6-07ae-420e-b95c-3f23a7bd0d77 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.171594 Jul 18 02:45:08.591762 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 530/1060] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:08 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:09.609689 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-f9b898b4-6448-4d21-a87e-7f82c4d4ed27 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:09.610319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-f9b898b4-6448-4d21-a87e-7f82c4d4ed27 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:09.618509 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f9b898b4-6448-4d21-a87e-7f82c4d4ed27 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:09.618969 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f9b898b4-6448-4d21-a87e-7f82c4d4ed27 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:09.619832 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f9b898b4-6448-4d21-a87e-7f82c4d4ed27 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:09.620307 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-f9b898b4-6448-4d21-a87e-7f82c4d4ed27 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:09.775551 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-f9b898b4-6448-4d21-a87e-7f82c4d4ed27 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:09.787383 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-f9b898b4-6448-4d21-a87e-7f82c4d4ed27 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.182542 Jul 18 02:45:09.788230 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 531/1061] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:09 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:10.807395 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d7472615-b782-4350-9ad4-52c23f18989e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:10.809070 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d7472615-b782-4350-9ad4-52c23f18989e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:10.816349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d7472615-b782-4350-9ad4-52c23f18989e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.816809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d7472615-b782-4350-9ad4-52c23f18989e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.817597 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d7472615-b782-4350-9ad4-52c23f18989e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:10.818040 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d7472615-b782-4350-9ad4-52c23f18989e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:10.968063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d7472615-b782-4350-9ad4-52c23f18989e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:10.977068 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d7472615-b782-4350-9ad4-52c23f18989e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.175648 Jul 18 02:45:10.986721 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 531/1062] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:10 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:11.993780 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d69918ce-b68e-4f13-8b57-7be4eda01951 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:11.994577 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d69918ce-b68e-4f13-8b57-7be4eda01951 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:12.001412 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d69918ce-b68e-4f13-8b57-7be4eda01951 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:12.001864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d69918ce-b68e-4f13-8b57-7be4eda01951 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:12.002744 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d69918ce-b68e-4f13-8b57-7be4eda01951 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:12.003231 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d69918ce-b68e-4f13-8b57-7be4eda01951 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:12.200003 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d69918ce-b68e-4f13-8b57-7be4eda01951 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:12.207644 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d69918ce-b68e-4f13-8b57-7be4eda01951 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.217742 Jul 18 02:45:12.212009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 532/1063] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:11 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:12.286800 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-19f8e192-83aa-44e6-9b4a-1c8f0d618b66 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:12.292017 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-19f8e192-83aa-44e6-9b4a-1c8f0d618b66 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:12.294577 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-19f8e192-83aa-44e6-9b4a-1c8f0d618b66 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:12.295134 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-19f8e192-83aa-44e6-9b4a-1c8f0d618b66 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:12.295905 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-19f8e192-83aa-44e6-9b4a-1c8f0d618b66 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:12.296349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-19f8e192-83aa-44e6-9b4a-1c8f0d618b66 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:12.324076 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-19f8e192-83aa-44e6-9b4a-1c8f0d618b66 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Going to try to terminate instance {{(pid=124890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:45:12.624449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-19f8e192-83aa-44e6-9b4a-1c8f0d618b66 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 204 len: 0 microversion: 2.1 time: 0.341471 Jul 18 02:45:12.625291 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 532/1064] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:45:12 2022] DELETE /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:45:12.633126 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fff22b4f-0491-4e3d-91b3-f782b2198dfd tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:12.634182 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fff22b4f-0491-4e3d-91b3-f782b2198dfd tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:12.640459 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fff22b4f-0491-4e3d-91b3-f782b2198dfd tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:12.640877 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fff22b4f-0491-4e3d-91b3-f782b2198dfd tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:12.641626 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fff22b4f-0491-4e3d-91b3-f782b2198dfd tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:12.642057 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fff22b4f-0491-4e3d-91b3-f782b2198dfd tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:12.776320 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fff22b4f-0491-4e3d-91b3-f782b2198dfd tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:12.783827 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fff22b4f-0491-4e3d-91b3-f782b2198dfd tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1514 microversion: 2.1 time: 0.154467 Jul 18 02:45:12.784392 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 533/1065] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:12 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:13.225211 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-dd3a15af-5c7d-4214-8159-14c3324cbe46 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:13.225914 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-dd3a15af-5c7d-4214-8159-14c3324cbe46 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:13.232845 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd3a15af-5c7d-4214-8159-14c3324cbe46 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.233296 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd3a15af-5c7d-4214-8159-14c3324cbe46 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.234064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd3a15af-5c7d-4214-8159-14c3324cbe46 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.234522 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-dd3a15af-5c7d-4214-8159-14c3324cbe46 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.363333 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-dd3a15af-5c7d-4214-8159-14c3324cbe46 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:13.370749 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-dd3a15af-5c7d-4214-8159-14c3324cbe46 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.149810 Jul 18 02:45:13.371314 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 533/1066] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:13 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:13.801822 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-88781f0a-64a2-468a-8a58-a99737b8d993 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:13.802495 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-88781f0a-64a2-468a-8a58-a99737b8d993 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:13.808969 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88781f0a-64a2-468a-8a58-a99737b8d993 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.809546 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88781f0a-64a2-468a-8a58-a99737b8d993 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.810361 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88781f0a-64a2-468a-8a58-a99737b8d993 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:13.810812 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-88781f0a-64a2-468a-8a58-a99737b8d993 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:13.938322 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-88781f0a-64a2-468a-8a58-a99737b8d993 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:13.946005 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-88781f0a-64a2-468a-8a58-a99737b8d993 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1514 microversion: 2.1 time: 0.148055 Jul 18 02:45:13.946607 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 534/1067] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:13 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:14.387251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c4217641-daae-4951-9136-3f7391fa71e3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:14.387982 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c4217641-daae-4951-9136-3f7391fa71e3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:14.394522 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c4217641-daae-4951-9136-3f7391fa71e3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.394976 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c4217641-daae-4951-9136-3f7391fa71e3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:14.395745 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c4217641-daae-4951-9136-3f7391fa71e3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.396187 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c4217641-daae-4951-9136-3f7391fa71e3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:14.525824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c4217641-daae-4951-9136-3f7391fa71e3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:14.533477 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c4217641-daae-4951-9136-3f7391fa71e3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.150243 Jul 18 02:45:14.534069 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 534/1068] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:14 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:14.963905 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bd5ace8e-8f2d-4269-a16d-b779cd0cb679 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:14.964500 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bd5ace8e-8f2d-4269-a16d-b779cd0cb679 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:14.971411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd5ace8e-8f2d-4269-a16d-b779cd0cb679 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.971881 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd5ace8e-8f2d-4269-a16d-b779cd0cb679 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:14.972643 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd5ace8e-8f2d-4269-a16d-b779cd0cb679 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:14.973072 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bd5ace8e-8f2d-4269-a16d-b779cd0cb679 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:15.139575 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bd5ace8e-8f2d-4269-a16d-b779cd0cb679 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:15.147062 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bd5ace8e-8f2d-4269-a16d-b779cd0cb679 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1514 microversion: 2.1 time: 0.187052 Jul 18 02:45:15.147632 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 535/1069] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:14 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:15.551245 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-10afd963-c3a9-4e47-a522-4d3e20f4834e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:15.551853 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-10afd963-c3a9-4e47-a522-4d3e20f4834e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:15.558431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-10afd963-c3a9-4e47-a522-4d3e20f4834e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:15.558887 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-10afd963-c3a9-4e47-a522-4d3e20f4834e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:15.559830 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-10afd963-c3a9-4e47-a522-4d3e20f4834e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:15.560302 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-10afd963-c3a9-4e47-a522-4d3e20f4834e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:15.694361 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-10afd963-c3a9-4e47-a522-4d3e20f4834e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:15.701995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-10afd963-c3a9-4e47-a522-4d3e20f4834e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.154667 Jul 18 02:45:15.702601 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 535/1070] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:15 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:16.164174 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9f71c106-9128-4a1a-9d24-889bcb7352fc tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:16.164791 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9f71c106-9128-4a1a-9d24-889bcb7352fc tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:16.172504 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9f71c106-9128-4a1a-9d24-889bcb7352fc tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.173368 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9f71c106-9128-4a1a-9d24-889bcb7352fc tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:16.174173 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9f71c106-9128-4a1a-9d24-889bcb7352fc tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.174614 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9f71c106-9128-4a1a-9d24-889bcb7352fc tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:16.274369 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-9f71c106-9128-4a1a-9d24-889bcb7352fc tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:16.284508 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9f71c106-9128-4a1a-9d24-889bcb7352fc tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1472 microversion: 2.1 time: 0.124223 Jul 18 02:45:16.285089 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 536/1071] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:16 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1472 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:16.294380 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-3c04a884-e6cf-4a8a-8be8-1dcef7403552 req-f0f25d6b-faaa-4b1b-9d9a-097cc100f7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a428e59c-6b34-4387-83d1-1d719eef2abf", "name": "network-vif-deleted", "tag": "d0204ed9-f9ee-4893-b615-fad157df027c"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:16.302870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-3c04a884-e6cf-4a8a-8be8-1dcef7403552 req-f0f25d6b-faaa-4b1b-9d9a-097cc100f7fa service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.308026 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-3c04a884-e6cf-4a8a-8be8-1dcef7403552 req-f0f25d6b-faaa-4b1b-9d9a-097cc100f7fa service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:16.314958 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-3c04a884-e6cf-4a8a-8be8-1dcef7403552 req-f0f25d6b-faaa-4b1b-9d9a-097cc100f7fa service nova] Creating event network-vif-deleted:d0204ed9-f9ee-4893-b615-fad157df027c for instance a428e59c-6b34-4387-83d1-1d719eef2abf on hv-cinder-85001 Jul 18 02:45:16.320971 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-3c04a884-e6cf-4a8a-8be8-1dcef7403552 req-f0f25d6b-faaa-4b1b-9d9a-097cc100f7fa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033610 Jul 18 02:45:16.321765 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 536/1072] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:16.719218 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5b23b34c-699e-4741-bb5a-6994d30b2b6f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:16.719847 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5b23b34c-699e-4741-bb5a-6994d30b2b6f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:16.726826 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b23b34c-699e-4741-bb5a-6994d30b2b6f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.727237 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b23b34c-699e-4741-bb5a-6994d30b2b6f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:16.728016 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b23b34c-699e-4741-bb5a-6994d30b2b6f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:16.728462 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b23b34c-699e-4741-bb5a-6994d30b2b6f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:16.858240 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5b23b34c-699e-4741-bb5a-6994d30b2b6f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:16.865711 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5b23b34c-699e-4741-bb5a-6994d30b2b6f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.151077 Jul 18 02:45:16.866328 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 537/1073] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:16 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:16.894989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:45:16.895380 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Mon Jul 18 02:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:45:17.303333 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:17.304035 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:17.311222 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:17.311672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:17.312553 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:17.312993 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:17.344177 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:17.344546 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:17.344995 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lazy-loading 'fault' on Instance uuid a428e59c-6b34-4387-83d1-1d719eef2abf {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:45:17.387178 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:17.394554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3c96c987-6525-4448-a1b1-d405cfa06581 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 200 len: 1309 microversion: 2.1 time: 0.095489 Jul 18 02:45:17.395117 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 537/1074] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:17 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:17.883639 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-bbe0f0dc-af10-4472-bcec-1502b709979b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:17.884205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-bbe0f0dc-af10-4472-bcec-1502b709979b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:17.891014 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bbe0f0dc-af10-4472-bcec-1502b709979b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:17.891467 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bbe0f0dc-af10-4472-bcec-1502b709979b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:17.892265 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bbe0f0dc-af10-4472-bcec-1502b709979b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:17.892693 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-bbe0f0dc-af10-4472-bcec-1502b709979b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.022762 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-bbe0f0dc-af10-4472-bcec-1502b709979b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:18.031025 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-bbe0f0dc-af10-4472-bcec-1502b709979b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.151452 Jul 18 02:45:18.031588 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 538/1075] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:17 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:18.377639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-f4473150-acbd-460d-9046-75b901fd29f7 req-37fd6a41-2e24-4431-98f3-401e362174ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3640269-34ee-4261-9b14-4bcfb5e666bd", "name": "network-vif-plugged", "status": "completed", "tag": "806e3d9e-a117-4a78-af51-028fc4c0d065"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:18.386858 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-f4473150-acbd-460d-9046-75b901fd29f7 req-37fd6a41-2e24-4431-98f3-401e362174ad service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:18.387301 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-f4473150-acbd-460d-9046-75b901fd29f7 req-37fd6a41-2e24-4431-98f3-401e362174ad service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.399248 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-f4473150-acbd-460d-9046-75b901fd29f7 req-37fd6a41-2e24-4431-98f3-401e362174ad service nova] Creating event network-vif-plugged:806e3d9e-a117-4a78-af51-028fc4c0d065 for instance b3640269-34ee-4261-9b14-4bcfb5e666bd on hv-cinder-85001 Jul 18 02:45:18.404165 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-f4473150-acbd-460d-9046-75b901fd29f7 req-37fd6a41-2e24-4431-98f3-401e362174ad service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030014 Jul 18 02:45:18.407601 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 538/1076] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:18.411933 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2b9727bc-8e08-4402-82c4-3847c46bfdea tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:18.412545 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2b9727bc-8e08-4402-82c4-3847c46bfdea tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: a428e59c-6b34-4387-83d1-1d719eef2abf] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:18.418632 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b9727bc-8e08-4402-82c4-3847c46bfdea tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:18.419072 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b9727bc-8e08-4402-82c4-3847c46bfdea tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.419874 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b9727bc-8e08-4402-82c4-3847c46bfdea tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:18.420315 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b9727bc-8e08-4402-82c4-3847c46bfdea tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:18.433403 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-2b9727bc-8e08-4402-82c4-3847c46bfdea tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] HTTP exception thrown: Instance a428e59c-6b34-4387-83d1-1d719eef2abf could not be found. Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2b9727bc-8e08-4402-82c4-3847c46bfdea tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Request method failure captured: Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf HTTP/1.1 Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MjvODvDxUYO7SEHt-XJTVLZqULy2ShpUM2NujoAITVCYZvqQ9nOW6NFBsIbJiNbhp2LyqJ-rNO3oD5gPAHBJeQ7VrjWtqo5aaNVhS7-CeQPX-BXDdUBFz3N9I3mHHUp-L8QtISzB4u199yCV6egk8YntE936qu1CW-jqitfBKBKO6g Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: ad2b132c879f4f5e90593713a3f472c1 Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1261081327 Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:45:18.435848 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ad2b132c879f4f5e90593713a3f472c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ad2b132c879f4f5e90593713a3f472c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ad2b132c879f4f5e90593713a3f472c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ad2b132c879f4f5e90593713a3f472c1", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-VolumesSnapshotTestJSON-1261081327 Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: ad2b132c879f4f5e90593713a3f472c1 Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1261081327 Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-VolumesSnapshotTestJSON-1261081327-project Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: b065087a79524114b5cacb8c5fd3254f Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-VolumesSnapshotTestJSON-1261081327-project Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance a428e59c-6b34-4387-83d1-1d719eef2abf could not be found. Jul 18 02:45:18.438863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': 'a428e59c-6b34-4387-83d1-1d719eef2abf'} Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a428e59c-6b34-4387-83d1-1d719eef2abf could not be found. Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:45:18.440989 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a428e59c-6b34-4387-83d1-1d719eef2abf could not be found. Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a428e59c-6b34-4387-83d1-1d719eef2abf could not be found. Jul 18 02:45:18.443966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:45:18.446950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2b9727bc-8e08-4402-82c4-3847c46bfdea tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Returning 404 to user: Instance a428e59c-6b34-4387-83d1-1d719eef2abf could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:45:18.446950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2b9727bc-8e08-4402-82c4-3847c46bfdea tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf" status: 404 len: 111 microversion: 2.1 time: 0.029198 Jul 18 02:45:18.446950 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 539/1077] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:18 2022] GET /compute/v2.1/servers/a428e59c-6b34-4387-83d1-1d719eef2abf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:45:19.047824 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-41ed9929-50e2-4159-a723-42a6af5aa7ad tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:19.048509 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-41ed9929-50e2-4159-a723-42a6af5aa7ad tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:19.054686 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-41ed9929-50e2-4159-a723-42a6af5aa7ad tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:19.055237 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-41ed9929-50e2-4159-a723-42a6af5aa7ad tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:19.056021 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-41ed9929-50e2-4159-a723-42a6af5aa7ad tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:19.056467 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-41ed9929-50e2-4159-a723-42a6af5aa7ad tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:19.189087 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-41ed9929-50e2-4159-a723-42a6af5aa7ad tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:19.196728 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-41ed9929-50e2-4159-a723-42a6af5aa7ad tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.153510 Jul 18 02:45:19.197288 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 539/1078] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:19 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:20.213975 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-e46b8007-3db9-42c1-802f-3751dfe0b949 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:20.214613 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-e46b8007-3db9-42c1-802f-3751dfe0b949 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:20.221814 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e46b8007-3db9-42c1-802f-3751dfe0b949 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:20.222297 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e46b8007-3db9-42c1-802f-3751dfe0b949 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:20.223058 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e46b8007-3db9-42c1-802f-3751dfe0b949 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:20.223494 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-e46b8007-3db9-42c1-802f-3751dfe0b949 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:20.352940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-e46b8007-3db9-42c1-802f-3751dfe0b949 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:20.360805 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-e46b8007-3db9-42c1-802f-3751dfe0b949 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.150650 Jul 18 02:45:20.361366 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 540/1079] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:20 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:21.377407 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c80f43ca-b8eb-4239-80ed-c84b431a1597 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:21.377972 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c80f43ca-b8eb-4239-80ed-c84b431a1597 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:21.384350 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c80f43ca-b8eb-4239-80ed-c84b431a1597 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:21.384819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c80f43ca-b8eb-4239-80ed-c84b431a1597 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:21.385571 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c80f43ca-b8eb-4239-80ed-c84b431a1597 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:21.386003 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c80f43ca-b8eb-4239-80ed-c84b431a1597 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:21.403690 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:21.516138 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c80f43ca-b8eb-4239-80ed-c84b431a1597 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:21.523754 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c80f43ca-b8eb-4239-80ed-c84b431a1597 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.150797 Jul 18 02:45:21.524354 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 540/1080] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:21 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:22.540938 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b6ba00eb-358f-4a63-9625-40e0256d2559 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:22.541554 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b6ba00eb-358f-4a63-9625-40e0256d2559 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:22.548990 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6ba00eb-358f-4a63-9625-40e0256d2559 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:22.549443 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6ba00eb-358f-4a63-9625-40e0256d2559 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:22.550252 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6ba00eb-358f-4a63-9625-40e0256d2559 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:22.550695 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b6ba00eb-358f-4a63-9625-40e0256d2559 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:22.554657 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:22.681995 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b6ba00eb-358f-4a63-9625-40e0256d2559 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:22.690068 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b6ba00eb-358f-4a63-9625-40e0256d2559 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1357 microversion: 2.1 time: 0.153064 Jul 18 02:45:22.691067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 541/1081] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:22 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:23.706821 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-55f35b5b-f631-46e2-9040-afc79088420a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:23.707423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-55f35b5b-f631-46e2-9040-afc79088420a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:23.709755 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:23.715175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-55f35b5b-f631-46e2-9040-afc79088420a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:23.715636 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-55f35b5b-f631-46e2-9040-afc79088420a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:23.716480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-55f35b5b-f631-46e2-9040-afc79088420a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:23.716951 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-55f35b5b-f631-46e2-9040-afc79088420a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:23.849883 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-55f35b5b-f631-46e2-9040-afc79088420a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:23.857178 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-55f35b5b-f631-46e2-9040-afc79088420a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1546 microversion: 2.1 time: 0.154687 Jul 18 02:45:23.857740 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 541/1082] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:23 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:23.873548 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c1ba773d-45f2-4eb4-8446-e3310284fcf7 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:23.874172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c1ba773d-45f2-4eb4-8446-e3310284fcf7 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:23.876871 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:23.881721 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1ba773d-45f2-4eb4-8446-e3310284fcf7 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:23.882205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1ba773d-45f2-4eb4-8446-e3310284fcf7 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:23.882968 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1ba773d-45f2-4eb4-8446-e3310284fcf7 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:23.883395 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c1ba773d-45f2-4eb4-8446-e3310284fcf7 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:24.014593 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c1ba773d-45f2-4eb4-8446-e3310284fcf7 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:24.022656 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c1ba773d-45f2-4eb4-8446-e3310284fcf7 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1546 microversion: 2.1 time: 0.153302 Jul 18 02:45:24.023213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 542/1083] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:23 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:24.038222 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0a203418-82cc-4a49-9524-224f2e1f7f1f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:24.041555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0a203418-82cc-4a49-9524-224f2e1f7f1f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:24.042384 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0a203418-82cc-4a49-9524-224f2e1f7f1f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Searching by: {'deleted': False, 'project_id': '73679a05b6dc4583842dacfeb898876f'} {{(pid=124890) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 02:45:24.049661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a203418-82cc-4a49-9524-224f2e1f7f1f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:24.050135 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a203418-82cc-4a49-9524-224f2e1f7f1f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:24.050932 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a203418-82cc-4a49-9524-224f2e1f7f1f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:24.051361 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0a203418-82cc-4a49-9524-224f2e1f7f1f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:24.138722 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.multi_cell_list [None req-0a203418-82cc-4a49-9524-224f2e1f7f1f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124890) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 02:45:24.233643 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0a203418-82cc-4a49-9524-224f2e1f7f1f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199108 Jul 18 02:45:24.234244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 542/1084] 10.222.0.66 () {58 vars in 1124 bytes} [Mon Jul 18 02:45:24 2022] GET /compute/v2.1/servers => generated 342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:24.244346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-abd41313-9a3a-4d1b-8883-7c933517315d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:24.244948 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-abd41313-9a3a-4d1b-8883-7c933517315d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:24.251478 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-abd41313-9a3a-4d1b-8883-7c933517315d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:24.251922 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-abd41313-9a3a-4d1b-8883-7c933517315d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:24.252673 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-abd41313-9a3a-4d1b-8883-7c933517315d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:24.253103 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-abd41313-9a3a-4d1b-8883-7c933517315d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:24.382668 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-abd41313-9a3a-4d1b-8883-7c933517315d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:24.390007 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-abd41313-9a3a-4d1b-8883-7c933517315d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1546 microversion: 2.1 time: 0.149408 Jul 18 02:45:24.390533 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 543/1085] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:24 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:29.179606 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-350908327", "imageRef": "ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c", "flavorRef": "452", "networks": [{"uuid": "c8e0fb7c-2761-451c-afcc-c07dac4a49ac"}]}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:29.230695 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.network.neutron [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] validate_networks() for [('c8e0fb7c-2761-451c-afcc-c07dac4a49ac', None, None, None, None, None)] {{(pid=124890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 02:45:29.598438 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Flavor limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 02:45:29.599013 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Image limits 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 02:45:29.599486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Flavor pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 02:45:29.599890 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Image pref 0:0:0 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 02:45:29.600296 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.virt.hardware [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 02:45:29.607817 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-7bb788ea-3357-44c4-a900-3804d4111380 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b796c7dc-a035-4710-a3ca-4ed2d923bb34"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:29.609069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-7bb788ea-3357-44c4-a900-3804d4111380 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:29.609933 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:29.610422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:29.611794 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:29.615705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:29.617154 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7bb788ea-3357-44c4-a900-3804d4111380 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:29.617645 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7bb788ea-3357-44c4-a900-3804d4111380 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:29.618474 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7bb788ea-3357-44c4-a900-3804d4111380 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:29.619420 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-7bb788ea-3357-44c4-a900-3804d4111380 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:29.629652 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Getting quotas for project ad2b132c879f4f5e90593713a3f472c1. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 02:45:29.633670 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.quota [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Getting quotas for user b065087a79524114b5cacb8c5fd3254f and project ad2b132c879f4f5e90593713a3f472c1. Resources: {'cores', 'ram', 'instances'} {{(pid=124890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 02:45:29.645231 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Going to run 1 instances... {{(pid=124890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 02:45:29.649173 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca99b7a4-bc7e-4033-a6f8-edbb3c0d1a8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 02:45:29.796214 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-36237e7b-5e12-403e-8bdb-2276668e9a40 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620393 Jul 18 02:45:29.796781 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 543/1086] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Jul 18 02:45:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 02:45:29.806895 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-833ca45c-e078-4b88-b423-ba3edf467802 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:29.807522 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-833ca45c-e078-4b88-b423-ba3edf467802 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:29.861928 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-833ca45c-e078-4b88-b423-ba3edf467802 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:29.868523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-833ca45c-e078-4b88-b423-ba3edf467802 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1218 microversion: 2.1 time: 0.065271 Jul 18 02:45:29.870061 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 544/1087] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:29 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:45:30.462167 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-7bb788ea-3357-44c4-a900-3804d4111380 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "POST /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857912 Jul 18 02:45:30.462775 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 544/1088] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:45:29 2022] POST /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:30.885999 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6e8f0a91-c74e-4f74-93e7-e6985a6d2c1d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:30.886641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6e8f0a91-c74e-4f74-93e7-e6985a6d2c1d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:30.893705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6e8f0a91-c74e-4f74-93e7-e6985a6d2c1d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:30.894304 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6e8f0a91-c74e-4f74-93e7-e6985a6d2c1d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:30.895140 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6e8f0a91-c74e-4f74-93e7-e6985a6d2c1d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:30.895607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6e8f0a91-c74e-4f74-93e7-e6985a6d2c1d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:30.957418 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6e8f0a91-c74e-4f74-93e7-e6985a6d2c1d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:30.965157 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6e8f0a91-c74e-4f74-93e7-e6985a6d2c1d tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1222 microversion: 2.1 time: 0.083200 Jul 18 02:45:30.967064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 545/1089] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:30 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:31.982918 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-13c9db2c-772b-4b26-b0cb-7c8e2f762abb tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:31.983610 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-13c9db2c-772b-4b26-b0cb-7c8e2f762abb tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:31.990472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-13c9db2c-772b-4b26-b0cb-7c8e2f762abb tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:31.990921 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-13c9db2c-772b-4b26-b0cb-7c8e2f762abb tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:31.991683 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-13c9db2c-772b-4b26-b0cb-7c8e2f762abb tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:31.992115 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-13c9db2c-772b-4b26-b0cb-7c8e2f762abb tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:32.055105 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-13c9db2c-772b-4b26-b0cb-7c8e2f762abb tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:32.062389 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-13c9db2c-772b-4b26-b0cb-7c8e2f762abb tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1270 microversion: 2.1 time: 0.083746 Jul 18 02:45:32.062978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 545/1090] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:31 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:33.079971 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-935b19b9-9c73-4a08-bc06-c2f99ab54bd8 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:33.080592 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-935b19b9-9c73-4a08-bc06-c2f99ab54bd8 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:33.087686 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-935b19b9-9c73-4a08-bc06-c2f99ab54bd8 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.088285 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-935b19b9-9c73-4a08-bc06-c2f99ab54bd8 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:33.089061 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-935b19b9-9c73-4a08-bc06-c2f99ab54bd8 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.089706 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-935b19b9-9c73-4a08-bc06-c2f99ab54bd8 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:33.224962 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-935b19b9-9c73-4a08-bc06-c2f99ab54bd8 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:33.233434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-935b19b9-9c73-4a08-bc06-c2f99ab54bd8 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1318 microversion: 2.1 time: 0.157499 Jul 18 02:45:33.234001 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 546/1091] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:33 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:33.798825 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1676c9bb-1cac-40c4-ad89-d384ed6a0724 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:33.799924 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1676c9bb-1cac-40c4-ad89-d384ed6a0724 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:33.807434 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1676c9bb-1cac-40c4-ad89-d384ed6a0724 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.808796 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1676c9bb-1cac-40c4-ad89-d384ed6a0724 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:33.809130 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1676c9bb-1cac-40c4-ad89-d384ed6a0724 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:33.810010 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1676c9bb-1cac-40c4-ad89-d384ed6a0724 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:33.999831 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-1676c9bb-1cac-40c4-ad89-d384ed6a0724 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:34.008550 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1676c9bb-1cac-40c4-ad89-d384ed6a0724 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1592 microversion: 2.1 time: 0.213945 Jul 18 02:45:34.011172 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 546/1092] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:33 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1592 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:34.204734 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-2640cca6-8a31-42b8-b89f-b6753c38e1b3 req-77b7e96e-f22d-4c99-ae5c-1e0c5e111749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082cd7d7-4392-4d0c-a2ba-33d0f875e18a", "tag": "0dc810cf-7837-4639-b458-b2ef55fd55a4"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:34.213806 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-2640cca6-8a31-42b8-b89f-b6753c38e1b3 req-77b7e96e-f22d-4c99-ae5c-1e0c5e111749 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:34.214486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-2640cca6-8a31-42b8-b89f-b6753c38e1b3 req-77b7e96e-f22d-4c99-ae5c-1e0c5e111749 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:34.226359 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-2640cca6-8a31-42b8-b89f-b6753c38e1b3 req-77b7e96e-f22d-4c99-ae5c-1e0c5e111749 service nova] Creating event network-changed:0dc810cf-7837-4639-b458-b2ef55fd55a4 for instance 082cd7d7-4392-4d0c-a2ba-33d0f875e18a on hv-cinder-85001 Jul 18 02:45:34.231335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-2640cca6-8a31-42b8-b89f-b6753c38e1b3 req-77b7e96e-f22d-4c99-ae5c-1e0c5e111749 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031265 Jul 18 02:45:34.232115 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 547/1093] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:34.250986 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8738405f-57f4-45d8-921b-122929327e90 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:34.251563 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8738405f-57f4-45d8-921b-122929327e90 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:34.258538 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8738405f-57f4-45d8-921b-122929327e90 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:34.258991 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8738405f-57f4-45d8-921b-122929327e90 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:34.259764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8738405f-57f4-45d8-921b-122929327e90 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:34.260230 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8738405f-57f4-45d8-921b-122929327e90 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:34.484392 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8738405f-57f4-45d8-921b-122929327e90 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:34.493303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8738405f-57f4-45d8-921b-122929327e90 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1318 microversion: 2.1 time: 0.246181 Jul 18 02:45:34.509898 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 547/1094] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:34 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:35.511285 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-559ae83e-c1f6-4859-b537-b42bc42c0782 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:35.512011 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-559ae83e-c1f6-4859-b537-b42bc42c0782 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:35.518861 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-559ae83e-c1f6-4859-b537-b42bc42c0782 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:35.519298 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-559ae83e-c1f6-4859-b537-b42bc42c0782 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:35.520083 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-559ae83e-c1f6-4859-b537-b42bc42c0782 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:35.520524 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-559ae83e-c1f6-4859-b537-b42bc42c0782 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:35.690261 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-559ae83e-c1f6-4859-b537-b42bc42c0782 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:35.698720 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-559ae83e-c1f6-4859-b537-b42bc42c0782 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1318 microversion: 2.1 time: 0.191660 Jul 18 02:45:35.699295 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 548/1095] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:35 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:36.263686 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-55f187be-7721-42b3-b1eb-88207aad6842 req-a76c6644-556f-4e53-a345-b1d5f1337654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3640269-34ee-4261-9b14-4bcfb5e666bd", "tag": "806e3d9e-a117-4a78-af51-028fc4c0d065"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:36.273129 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-55f187be-7721-42b3-b1eb-88207aad6842 req-a76c6644-556f-4e53-a345-b1d5f1337654 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:36.273978 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-55f187be-7721-42b3-b1eb-88207aad6842 req-a76c6644-556f-4e53-a345-b1d5f1337654 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:36.286077 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-55f187be-7721-42b3-b1eb-88207aad6842 req-a76c6644-556f-4e53-a345-b1d5f1337654 service nova] Creating event network-changed:806e3d9e-a117-4a78-af51-028fc4c0d065 for instance b3640269-34ee-4261-9b14-4bcfb5e666bd on hv-cinder-85001 Jul 18 02:45:36.291088 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-55f187be-7721-42b3-b1eb-88207aad6842 req-a76c6644-556f-4e53-a345-b1d5f1337654 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031114 Jul 18 02:45:36.291903 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 548/1096] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:36.715156 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-01951623-5387-4856-b6c4-967a1d42ab25 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:36.717015 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-01951623-5387-4856-b6c4-967a1d42ab25 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:36.722768 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-01951623-5387-4856-b6c4-967a1d42ab25 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:36.723357 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-01951623-5387-4856-b6c4-967a1d42ab25 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:36.724240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-01951623-5387-4856-b6c4-967a1d42ab25 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:36.724816 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-01951623-5387-4856-b6c4-967a1d42ab25 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:36.863318 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-01951623-5387-4856-b6c4-967a1d42ab25 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:36.872847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-01951623-5387-4856-b6c4-967a1d42ab25 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1318 microversion: 2.1 time: 0.161597 Jul 18 02:45:36.873659 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 549/1097] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:36 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:37.891803 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2a114a8d-3d27-4162-9a46-92336be67f02 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:37.892506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2a114a8d-3d27-4162-9a46-92336be67f02 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:37.899379 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2a114a8d-3d27-4162-9a46-92336be67f02 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:37.899849 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2a114a8d-3d27-4162-9a46-92336be67f02 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:37.900630 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2a114a8d-3d27-4162-9a46-92336be67f02 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:37.901070 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2a114a8d-3d27-4162-9a46-92336be67f02 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:38.313901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-2a114a8d-3d27-4162-9a46-92336be67f02 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:38.322569 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2a114a8d-3d27-4162-9a46-92336be67f02 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1318 microversion: 2.1 time: 0.435531 Jul 18 02:45:38.323139 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 549/1098] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:37 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:39.339491 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-f890f15b-685c-424a-b26b-b51175cf489b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:39.340371 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-f890f15b-685c-424a-b26b-b51175cf489b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:39.364848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f890f15b-685c-424a-b26b-b51175cf489b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:39.364848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f890f15b-685c-424a-b26b-b51175cf489b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:39.364848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f890f15b-685c-424a-b26b-b51175cf489b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:39.364848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-f890f15b-685c-424a-b26b-b51175cf489b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:39.489861 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-f890f15b-685c-424a-b26b-b51175cf489b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:39.497313 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-f890f15b-685c-424a-b26b-b51175cf489b tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1318 microversion: 2.1 time: 0.162020 Jul 18 02:45:39.497876 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 550/1099] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:39 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:39.609312 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6dd4065c-aba6-4ea6-b79a-ad1595b3f3af tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1147507889"}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:39.609912 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6dd4065c-aba6-4ea6-b79a-ad1595b3f3af tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:39.616820 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6dd4065c-aba6-4ea6-b79a-ad1595b3f3af tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:39.617374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6dd4065c-aba6-4ea6-b79a-ad1595b3f3af tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:39.618238 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6dd4065c-aba6-4ea6-b79a-ad1595b3f3af tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:39.618678 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6dd4065c-aba6-4ea6-b79a-ad1595b3f3af tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:39.757302 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.network.security_group_api [None req-6dd4065c-aba6-4ea6-b79a-ad1595b3f3af tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Adding security group af6413b7-1db5-4f43-a429-9ff82004545b to port 806e3d9e-a117-4a78-af51-028fc4c0d065 Jul 18 02:45:40.161657 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6dd4065c-aba6-4ea6-b79a-ad1595b3f3af tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "POST /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/action" status: 202 len: 0 microversion: 2.1 time: 0.557123 Jul 18 02:45:40.162325 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 550/1100] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:45:39 2022] POST /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:45:40.174846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-9d0727ce-85e9-4778-ae7c-7edea8a9aaa7 req-9ab90e35-9270-41f0-b12e-3e01e18c927f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3640269-34ee-4261-9b14-4bcfb5e666bd", "tag": "806e3d9e-a117-4a78-af51-028fc4c0d065"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:40.181672 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-2888af16-3668-4569-8290-11a143831e22 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:40.183277 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-2888af16-3668-4569-8290-11a143831e22 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:40.186518 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=4 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:40.189034 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell0:SELECT=8 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:40.205854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2888af16-3668-4569-8290-11a143831e22 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:40.206361 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2888af16-3668-4569-8290-11a143831e22 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:40.207161 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2888af16-3668-4569-8290-11a143831e22 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:40.207644 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-2888af16-3668-4569-8290-11a143831e22 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:40.211803 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-9d0727ce-85e9-4778-ae7c-7edea8a9aaa7 req-9ab90e35-9270-41f0-b12e-3e01e18c927f service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:40.212377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-9d0727ce-85e9-4778-ae7c-7edea8a9aaa7 req-9ab90e35-9270-41f0-b12e-3e01e18c927f service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:40.227346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-9d0727ce-85e9-4778-ae7c-7edea8a9aaa7 req-9ab90e35-9270-41f0-b12e-3e01e18c927f service nova] Creating event network-changed:806e3d9e-a117-4a78-af51-028fc4c0d065 for instance b3640269-34ee-4261-9b14-4bcfb5e666bd on hv-cinder-85001 Jul 18 02:45:40.232448 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-9d0727ce-85e9-4778-ae7c-7edea8a9aaa7 req-9ab90e35-9270-41f0-b12e-3e01e18c927f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061277 Jul 18 02:45:40.233122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 551/1101] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:40.389563 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-2888af16-3668-4569-8290-11a143831e22 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:40.397773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-2888af16-3668-4569-8290-11a143831e22 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1758 microversion: 2.1 time: 0.230655 Jul 18 02:45:40.403482 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 551/1102] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:40 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1758 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:40.515141 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-01839389-2681-4d13-b8c1-8534a522e8ba tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:40.515840 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-01839389-2681-4d13-b8c1-8534a522e8ba tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:40.523395 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01839389-2681-4d13-b8c1-8534a522e8ba tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:40.524146 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01839389-2681-4d13-b8c1-8534a522e8ba tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:40.525131 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01839389-2681-4d13-b8c1-8534a522e8ba tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:40.525763 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01839389-2681-4d13-b8c1-8534a522e8ba tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:40.718203 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-01839389-2681-4d13-b8c1-8534a522e8ba tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:40.727610 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-01839389-2681-4d13-b8c1-8534a522e8ba tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1318 microversion: 2.1 time: 0.216577 Jul 18 02:45:40.728660 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 552/1103] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:40 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:40.885900 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-13c8a193-2d3e-4743-95ca-584bacc65acb req-a8d10842-93b1-4cb4-a107-7a5e3d503084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082cd7d7-4392-4d0c-a2ba-33d0f875e18a", "name": "network-vif-plugged", "status": "completed", "tag": "0dc810cf-7837-4639-b458-b2ef55fd55a4"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:40.895282 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-13c8a193-2d3e-4743-95ca-584bacc65acb req-a8d10842-93b1-4cb4-a107-7a5e3d503084 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:40.895741 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-13c8a193-2d3e-4743-95ca-584bacc65acb req-a8d10842-93b1-4cb4-a107-7a5e3d503084 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:40.907721 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-13c8a193-2d3e-4743-95ca-584bacc65acb req-a8d10842-93b1-4cb4-a107-7a5e3d503084 service nova] Creating event network-vif-plugged:0dc810cf-7837-4639-b458-b2ef55fd55a4 for instance 082cd7d7-4392-4d0c-a2ba-33d0f875e18a on hv-cinder-85001 Jul 18 02:45:40.913300 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-13c8a193-2d3e-4743-95ca-584bacc65acb req-a8d10842-93b1-4cb4-a107-7a5e3d503084 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031659 Jul 18 02:45:40.913916 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 552/1104] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:41.745105 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0b3a9146-8cab-4bb8-97ea-ce391c445b88 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:41.745756 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0b3a9146-8cab-4bb8-97ea-ce391c445b88 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:41.752164 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b3a9146-8cab-4bb8-97ea-ce391c445b88 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:41.755506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b3a9146-8cab-4bb8-97ea-ce391c445b88 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:41.755506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b3a9146-8cab-4bb8-97ea-ce391c445b88 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:41.755506 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0b3a9146-8cab-4bb8-97ea-ce391c445b88 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:41.886658 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0b3a9146-8cab-4bb8-97ea-ce391c445b88 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:41.894169 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0b3a9146-8cab-4bb8-97ea-ce391c445b88 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1318 microversion: 2.1 time: 0.152803 Jul 18 02:45:41.895037 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 553/1105] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:41 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:42.912868 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6b8f7584-9d07-4d29-8fd0-9183ea68dda1 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:42.913584 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6b8f7584-9d07-4d29-8fd0-9183ea68dda1 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:42.920073 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6b8f7584-9d07-4d29-8fd0-9183ea68dda1 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:42.923984 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6b8f7584-9d07-4d29-8fd0-9183ea68dda1 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:42.923984 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6b8f7584-9d07-4d29-8fd0-9183ea68dda1 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:42.923984 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6b8f7584-9d07-4d29-8fd0-9183ea68dda1 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:43.053567 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6b8f7584-9d07-4d29-8fd0-9183ea68dda1 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:43.061072 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6b8f7584-9d07-4d29-8fd0-9183ea68dda1 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1318 microversion: 2.1 time: 0.153768 Jul 18 02:45:43.061649 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 553/1106] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:42 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:44.078220 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6f845629-7eb2-4dfe-9658-362b87ee2f3a tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:44.078842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6f845629-7eb2-4dfe-9658-362b87ee2f3a tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:44.086133 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f845629-7eb2-4dfe-9658-362b87ee2f3a tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:44.086701 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f845629-7eb2-4dfe-9658-362b87ee2f3a tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:44.087472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f845629-7eb2-4dfe-9658-362b87ee2f3a tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:44.087942 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6f845629-7eb2-4dfe-9658-362b87ee2f3a tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:44.215771 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6f845629-7eb2-4dfe-9658-362b87ee2f3a tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:44.223156 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6f845629-7eb2-4dfe-9658-362b87ee2f3a tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1507 microversion: 2.1 time: 0.148917 Jul 18 02:45:44.223846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 554/1107] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:44 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:44.239426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8a99d79a-ade0-4ee6-b102-408031230c24 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6da6e22d-4023-4d9d-83ad-38f7ddf33d5b", "device": "/dev/sdb"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:44.241090 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8a99d79a-ade0-4ee6-b102-408031230c24 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:44.247520 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a99d79a-ade0-4ee6-b102-408031230c24 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:44.247974 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a99d79a-ade0-4ee6-b102-408031230c24 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:44.248738 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a99d79a-ade0-4ee6-b102-408031230c24 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:44.249188 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8a99d79a-ade0-4ee6-b102-408031230c24 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:45.043412 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8a99d79a-ade0-4ee6-b102-408031230c24 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "POST /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807906 Jul 18 02:45:45.044018 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 554/1108] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Jul 18 02:45:44 2022] POST /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:57.944498 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-eb04bd2a-dd3c-4111-a972-85189c8133a9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:57.945096 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:57.945475 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-eb04bd2a-dd3c-4111-a972-85189c8133a9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:57.946040 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:57.949114 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=25 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:57.950113 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:57.957540 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eb04bd2a-dd3c-4111-a972-85189c8133a9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:57.957540 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eb04bd2a-dd3c-4111-a972-85189c8133a9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:57.957540 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eb04bd2a-dd3c-4111-a972-85189c8133a9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:57.957540 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-eb04bd2a-dd3c-4111-a972-85189c8133a9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:57.983319 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-eb04bd2a-dd3c-4111-a972-85189c8133a9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:45:58.025377 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-5e454564-3c40-4748-82a1-debf578f36c6 req-79b3106e-71ef-413b-9de1-d0a81cb5d695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef000cad-4622-4a4d-883f-58fafad96e81", "tag": "5d5f39d1-25cc-45c5-98de-5bdf6d03c941"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:45:58.034946 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-5e454564-3c40-4748-82a1-debf578f36c6 req-79b3106e-71ef-413b-9de1-d0a81cb5d695 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:58.035566 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-5e454564-3c40-4748-82a1-debf578f36c6 req-79b3106e-71ef-413b-9de1-d0a81cb5d695 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:58.048955 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-5e454564-3c40-4748-82a1-debf578f36c6 req-79b3106e-71ef-413b-9de1-d0a81cb5d695 service nova] Creating event network-changed:5d5f39d1-25cc-45c5-98de-5bdf6d03c941 for instance ef000cad-4622-4a4d-883f-58fafad96e81 on hv-cinder-85001 Jul 18 02:45:58.055300 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-5e454564-3c40-4748-82a1-debf578f36c6 req-79b3106e-71ef-413b-9de1-d0a81cb5d695 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112094 Jul 18 02:45:58.056077 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 555/1109] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:45:58.319317 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-eb04bd2a-dd3c-4111-a972-85189c8133a9 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 204 len: 0 microversion: 2.1 time: 0.378937 Jul 18 02:45:58.324777 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 555/1110] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:45:57 2022] DELETE /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:45:58.330639 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-96e4e44b-97d0-4ee6-bb74-78e1948b38c0 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:58.331333 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-96e4e44b-97d0-4ee6-bb74-78e1948b38c0 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:58.339002 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-96e4e44b-97d0-4ee6-bb74-78e1948b38c0 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:58.339448 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-96e4e44b-97d0-4ee6-bb74-78e1948b38c0 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:58.340206 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-96e4e44b-97d0-4ee6-bb74-78e1948b38c0 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:58.340633 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-96e4e44b-97d0-4ee6-bb74-78e1948b38c0 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:58.494500 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-96e4e44b-97d0-4ee6-bb74-78e1948b38c0 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:58.502551 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-96e4e44b-97d0-4ee6-bb74-78e1948b38c0 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1578 microversion: 2.1 time: 0.176272 Jul 18 02:45:58.503126 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 556/1111] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:58 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:45:59.520825 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4add23ba-d1d4-4525-9ad4-327186fbdea2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:45:59.521518 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4add23ba-d1d4-4525-9ad4-327186fbdea2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:45:59.528268 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4add23ba-d1d4-4525-9ad4-327186fbdea2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:59.528717 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4add23ba-d1d4-4525-9ad4-327186fbdea2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:59.529504 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4add23ba-d1d4-4525-9ad4-327186fbdea2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:45:59.529973 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4add23ba-d1d4-4525-9ad4-327186fbdea2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:45:59.669678 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4add23ba-d1d4-4525-9ad4-327186fbdea2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:45:59.677234 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4add23ba-d1d4-4525-9ad4-327186fbdea2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1578 microversion: 2.1 time: 0.160986 Jul 18 02:45:59.677816 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 556/1112] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:45:59 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:00.696033 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6fc25c9c-64a4-46f7-8c42-9d2f2ca1203d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:00.696650 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6fc25c9c-64a4-46f7-8c42-9d2f2ca1203d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:00.703392 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6fc25c9c-64a4-46f7-8c42-9d2f2ca1203d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:00.703847 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6fc25c9c-64a4-46f7-8c42-9d2f2ca1203d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:00.704607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6fc25c9c-64a4-46f7-8c42-9d2f2ca1203d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:00.705046 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6fc25c9c-64a4-46f7-8c42-9d2f2ca1203d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:00.834743 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6fc25c9c-64a4-46f7-8c42-9d2f2ca1203d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:00.842244 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6fc25c9c-64a4-46f7-8c42-9d2f2ca1203d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1578 microversion: 2.1 time: 0.150235 Jul 18 02:46:00.842818 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 557/1113] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:00 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:01.860067 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5b714059-dc57-43df-8d07-5b3bdcd2bb08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:01.860678 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-5b714059-dc57-43df-8d07-5b3bdcd2bb08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:01.867799 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b714059-dc57-43df-8d07-5b3bdcd2bb08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:01.868190 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b714059-dc57-43df-8d07-5b3bdcd2bb08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:01.868954 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b714059-dc57-43df-8d07-5b3bdcd2bb08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:01.869391 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-5b714059-dc57-43df-8d07-5b3bdcd2bb08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:02.026970 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-5b714059-dc57-43df-8d07-5b3bdcd2bb08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:02.034495 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5b714059-dc57-43df-8d07-5b3bdcd2bb08 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1578 microversion: 2.1 time: 0.178284 Jul 18 02:46:02.035074 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 557/1114] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:01 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:02.969921 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-374cb468-e1f2-4b7d-a735-d5f36b4ad5ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:02.970951 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-374cb468-e1f2-4b7d-a735-d5f36b4ad5ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:02.978287 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-374cb468-e1f2-4b7d-a735-d5f36b4ad5ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:02.978810 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-374cb468-e1f2-4b7d-a735-d5f36b4ad5ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:02.979607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-374cb468-e1f2-4b7d-a735-d5f36b4ad5ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:02.980043 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-374cb468-e1f2-4b7d-a735-d5f36b4ad5ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:03.051791 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-65919a0a-9616-4524-93a4-13166baee0d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:03.052527 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-65919a0a-9616-4524-93a4-13166baee0d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:03.060185 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65919a0a-9616-4524-93a4-13166baee0d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:03.060633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65919a0a-9616-4524-93a4-13166baee0d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:03.061408 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65919a0a-9616-4524-93a4-13166baee0d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:03.061856 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-65919a0a-9616-4524-93a4-13166baee0d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:03.186667 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-374cb468-e1f2-4b7d-a735-d5f36b4ad5ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "POST /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/action" status: 202 len: 0 microversion: 2.1 time: 0.220339 Jul 18 02:46:03.187614 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 558/1115] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:46:02 2022] POST /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:46:03.196087 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8078f3e4-22cd-4bfe-bf66-c8612e682ba0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:03.196792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8078f3e4-22cd-4bfe-bf66-c8612e682ba0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:03.202979 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8078f3e4-22cd-4bfe-bf66-c8612e682ba0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:03.203426 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8078f3e4-22cd-4bfe-bf66-c8612e682ba0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:03.204193 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8078f3e4-22cd-4bfe-bf66-c8612e682ba0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:03.204623 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8078f3e4-22cd-4bfe-bf66-c8612e682ba0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:03.295314 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-65919a0a-9616-4524-93a4-13166baee0d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:03.306953 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-65919a0a-9616-4524-93a4-13166baee0d6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1459 microversion: 2.1 time: 0.259082 Jul 18 02:46:03.308246 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 558/1116] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:03 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1459 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:03.366056 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8078f3e4-22cd-4bfe-bf66-c8612e682ba0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:03.374955 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8078f3e4-22cd-4bfe-bf66-c8612e682ba0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1750 microversion: 2.1 time: 0.182899 Jul 18 02:46:03.375523 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 559/1117] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:03 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:03.814904 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-b5af0faf-1fc0-42e9-a45c-3e2dd83694d8 req-7068253b-9566-4d3a-99cc-106cf15ea6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef000cad-4622-4a4d-883f-58fafad96e81", "name": "network-vif-deleted", "tag": "5d5f39d1-25cc-45c5-98de-5bdf6d03c941"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:03.834522 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-b5af0faf-1fc0-42e9-a45c-3e2dd83694d8 req-7068253b-9566-4d3a-99cc-106cf15ea6df service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:03.834522 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-b5af0faf-1fc0-42e9-a45c-3e2dd83694d8 req-7068253b-9566-4d3a-99cc-106cf15ea6df service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:03.845966 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-b5af0faf-1fc0-42e9-a45c-3e2dd83694d8 req-7068253b-9566-4d3a-99cc-106cf15ea6df service nova] Creating event network-vif-deleted:5d5f39d1-25cc-45c5-98de-5bdf6d03c941 for instance ef000cad-4622-4a4d-883f-58fafad96e81 on hv-cinder-85001 Jul 18 02:46:03.851774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-b5af0faf-1fc0-42e9-a45c-3e2dd83694d8 req-7068253b-9566-4d3a-99cc-106cf15ea6df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040473 Jul 18 02:46:03.852374 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 559/1118] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:04.325440 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d7e5538e-a2ee-4835-af25-0d61c5ac8d83 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:04.326225 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d7e5538e-a2ee-4835-af25-0d61c5ac8d83 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:04.332975 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d7e5538e-a2ee-4835-af25-0d61c5ac8d83 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:04.333373 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d7e5538e-a2ee-4835-af25-0d61c5ac8d83 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:04.334899 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d7e5538e-a2ee-4835-af25-0d61c5ac8d83 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:04.335416 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d7e5538e-a2ee-4835-af25-0d61c5ac8d83 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:04.394296 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-b9afb815-317a-4eef-ba88-3fc8db76ea7f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:04.395069 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-b9afb815-317a-4eef-ba88-3fc8db76ea7f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:04.403091 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d7e5538e-a2ee-4835-af25-0d61c5ac8d83 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:04.403868 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b9afb815-317a-4eef-ba88-3fc8db76ea7f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:04.404331 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b9afb815-317a-4eef-ba88-3fc8db76ea7f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:04.405122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b9afb815-317a-4eef-ba88-3fc8db76ea7f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:04.405990 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-b9afb815-317a-4eef-ba88-3fc8db76ea7f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:04.411335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d7e5538e-a2ee-4835-af25-0d61c5ac8d83 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1225 microversion: 2.1 time: 0.089656 Jul 18 02:46:04.412123 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 560/1119] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:04 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:04.553465 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-b9afb815-317a-4eef-ba88-3fc8db76ea7f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:04.561453 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-b9afb815-317a-4eef-ba88-3fc8db76ea7f tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.172352 Jul 18 02:46:04.567572 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 560/1120] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:04 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:05.430635 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:05.448360 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:05.448360 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:05.448360 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:05.448360 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:05.448784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:05.476449 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:05.476903 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:05.477356 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lazy-loading 'fault' on Instance uuid ef000cad-4622-4a4d-883f-58fafad96e81 {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:46:05.518943 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:05.527341 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0b4702b5-884a-4463-a4db-951cd4ae7fa6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 200 len: 1230 microversion: 2.1 time: 0.102307 Jul 18 02:46:05.531215 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 561/1121] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:05 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:05.579714 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-58887ff7-8da3-48c1-99d9-d47f07be5a35 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:05.580318 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-58887ff7-8da3-48c1-99d9-d47f07be5a35 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:05.587348 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58887ff7-8da3-48c1-99d9-d47f07be5a35 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:05.587798 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58887ff7-8da3-48c1-99d9-d47f07be5a35 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:05.588555 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58887ff7-8da3-48c1-99d9-d47f07be5a35 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:05.588992 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-58887ff7-8da3-48c1-99d9-d47f07be5a35 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:05.737521 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-58887ff7-8da3-48c1-99d9-d47f07be5a35 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:05.745765 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-58887ff7-8da3-48c1-99d9-d47f07be5a35 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.169948 Jul 18 02:46:05.746405 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 561/1122] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:05 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:06.178368 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-fb97d406-b4a1-4a70-9eba-1186a6a98d94 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:06.178865 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-fb97d406-b4a1-4a70-9eba-1186a6a98d94 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:06.184823 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fb97d406-b4a1-4a70-9eba-1186a6a98d94 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:06.185281 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fb97d406-b4a1-4a70-9eba-1186a6a98d94 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:06.186037 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fb97d406-b4a1-4a70-9eba-1186a6a98d94 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:06.186500 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-fb97d406-b4a1-4a70-9eba-1186a6a98d94 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:06.265233 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-fb97d406-b4a1-4a70-9eba-1186a6a98d94 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lazy-loading 'services' on Instance uuid 082cd7d7-4392-4d0c-a2ba-33d0f875e18a {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:46:06.467049 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-fb97d406-b4a1-4a70-9eba-1186a6a98d94 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "DELETE /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a/os-volume_attachments/6da6e22d-4023-4d9d-83ad-38f7ddf33d5b" status: 202 len: 0 microversion: 2.1 time: 0.292953 Jul 18 02:46:06.467744 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 562/1123] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:46:06 2022] DELETE /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a/os-volume_attachments/6da6e22d-4023-4d9d-83ad-38f7ddf33d5b => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:46:06.544242 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ae420804-3086-40bf-824b-459a437f4ab7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:06.544857 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-ae420804-3086-40bf-824b-459a437f4ab7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: ef000cad-4622-4a4d-883f-58fafad96e81] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:06.550930 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ae420804-3086-40bf-824b-459a437f4ab7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:06.551383 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ae420804-3086-40bf-824b-459a437f4ab7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:06.552250 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ae420804-3086-40bf-824b-459a437f4ab7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:06.553471 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-ae420804-3086-40bf-824b-459a437f4ab7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:06.567580 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-ae420804-3086-40bf-824b-459a437f4ab7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] HTTP exception thrown: Instance ef000cad-4622-4a4d-883f-58fafad96e81 could not be found. Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ae420804-3086-40bf-824b-459a437f4ab7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Request method failure captured: Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 HTTP/1.1 Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MdxaPdbAazZUjAbFLfDD-BhuS0wZmHyZWnJFNNV8MI8fuxJbmVympsiuxnwmNE6ch6KfpCH1DYfIbYNTqQHTFyHLN2g8HbEiWT8ZIoav6ekZ_p8oN_jjSHxG9I2rbxTRlMVA0GzZ8cfv75mbVYcFrrffaqPLaVo0JMbLozvzr75mNs Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 807f88779cf842f3bbe09615d470f44c Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:46:06.572355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_807f88779cf842f3bbe09615d470f44c", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 807f88779cf842f3bbe09615d470f44c Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-TestVolumeBootPattern-1838735271-project Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 41a452eca3af46b09f56a80fa8652247 Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-TestVolumeBootPattern-1838735271-project Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance ef000cad-4622-4a4d-883f-58fafad96e81 could not be found. Jul 18 02:46:06.574138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': 'ef000cad-4622-4a4d-883f-58fafad96e81'} Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef000cad-4622-4a4d-883f-58fafad96e81 could not be found. Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:06.575093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef000cad-4622-4a4d-883f-58fafad96e81 could not be found. Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef000cad-4622-4a4d-883f-58fafad96e81 could not be found. Jul 18 02:46:06.576764 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:06.578238 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-ae420804-3086-40bf-824b-459a437f4ab7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Returning 404 to user: Instance ef000cad-4622-4a4d-883f-58fafad96e81 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:06.578238 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-ae420804-3086-40bf-824b-459a437f4ab7 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81" status: 404 len: 111 microversion: 2.1 time: 0.030415 Jul 18 02:46:06.578238 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 562/1124] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:06 2022] GET /compute/v2.1/servers/ef000cad-4622-4a4d-883f-58fafad96e81 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:46:06.764410 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-9719d38b-90f7-459e-9b0a-324ea96b617c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:06.765273 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-9719d38b-90f7-459e-9b0a-324ea96b617c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:06.771646 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9719d38b-90f7-459e-9b0a-324ea96b617c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:06.773151 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9719d38b-90f7-459e-9b0a-324ea96b617c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:06.773151 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9719d38b-90f7-459e-9b0a-324ea96b617c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:06.773346 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-9719d38b-90f7-459e-9b0a-324ea96b617c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:06.921475 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-9719d38b-90f7-459e-9b0a-324ea96b617c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:06.929838 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-9719d38b-90f7-459e-9b0a-324ea96b617c tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.170187 Jul 18 02:46:06.930532 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 563/1125] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:06 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:07.947706 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-15a20dde-aecf-4431-bdab-c200f30631a3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:07.948303 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-15a20dde-aecf-4431-bdab-c200f30631a3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:07.954639 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-15a20dde-aecf-4431-bdab-c200f30631a3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:07.955085 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-15a20dde-aecf-4431-bdab-c200f30631a3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:07.955838 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-15a20dde-aecf-4431-bdab-c200f30631a3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:07.956268 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-15a20dde-aecf-4431-bdab-c200f30631a3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:08.103261 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-15a20dde-aecf-4431-bdab-c200f30631a3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:08.109440 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-15a20dde-aecf-4431-bdab-c200f30631a3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.166233 Jul 18 02:46:08.110000 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 563/1126] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:07 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:08.632854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1192c344-00a5-43bc-a6f6-827b70e22497 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:08.633374 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1192c344-00a5-43bc-a6f6-827b70e22497 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:08.640009 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1192c344-00a5-43bc-a6f6-827b70e22497 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:08.640455 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1192c344-00a5-43bc-a6f6-827b70e22497 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:08.641224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1192c344-00a5-43bc-a6f6-827b70e22497 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:08.641659 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1192c344-00a5-43bc-a6f6-827b70e22497 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:08.666589 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1192c344-00a5-43bc-a6f6-827b70e22497 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Going to try to terminate instance {{(pid=124890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:46:09.027025 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1192c344-00a5-43bc-a6f6-827b70e22497 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "DELETE /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 204 len: 0 microversion: 2.1 time: 0.398336 Jul 18 02:46:09.027691 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 564/1127] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:46:08 2022] DELETE /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:46:09.035798 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-fef12fae-8956-40c6-ac78-582dae53ea86 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:09.036616 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-fef12fae-8956-40c6-ac78-582dae53ea86 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:09.043985 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fef12fae-8956-40c6-ac78-582dae53ea86 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:09.043985 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fef12fae-8956-40c6-ac78-582dae53ea86 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:09.044741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fef12fae-8956-40c6-ac78-582dae53ea86 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:09.045179 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-fef12fae-8956-40c6-ac78-582dae53ea86 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:09.128062 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d8fec49c-f72c-4ca5-a6a8-805db6f25e51 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:09.128757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d8fec49c-f72c-4ca5-a6a8-805db6f25e51 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:09.134814 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8fec49c-f72c-4ca5-a6a8-805db6f25e51 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:09.135260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8fec49c-f72c-4ca5-a6a8-805db6f25e51 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:09.136027 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8fec49c-f72c-4ca5-a6a8-805db6f25e51 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:09.136457 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d8fec49c-f72c-4ca5-a6a8-805db6f25e51 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:09.259751 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-fef12fae-8956-40c6-ac78-582dae53ea86 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:09.267724 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-fef12fae-8956-40c6-ac78-582dae53ea86 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1513 microversion: 2.1 time: 0.235661 Jul 18 02:46:09.268565 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 564/1128] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:09 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:09.283253 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d8fec49c-f72c-4ca5-a6a8-805db6f25e51 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:09.292184 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d8fec49c-f72c-4ca5-a6a8-805db6f25e51 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.168440 Jul 18 02:46:09.292860 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 565/1129] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:09 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:10.269418 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-244e722d-b8a5-4265-ae4e-00922623c200 req-67657022-5ef4-4aad-b2f9-912c9f6b4dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d47ffd3-9df5-400c-8cef-efcc7d6d97cd", "tag": "b0f73b8a-a342-4961-8be0-cc1c0a325389"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:10.277089 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2968cf04-855b-46b4-9499-3f2a69f6dd6c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:10.277582 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2968cf04-855b-46b4-9499-3f2a69f6dd6c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:10.284309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2968cf04-855b-46b4-9499-3f2a69f6dd6c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.284519 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-244e722d-b8a5-4265-ae4e-00922623c200 req-67657022-5ef4-4aad-b2f9-912c9f6b4dd4 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.284776 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2968cf04-855b-46b4-9499-3f2a69f6dd6c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.285192 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-244e722d-b8a5-4265-ae4e-00922623c200 req-67657022-5ef4-4aad-b2f9-912c9f6b4dd4 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.285559 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2968cf04-855b-46b4-9499-3f2a69f6dd6c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.286003 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2968cf04-855b-46b4-9499-3f2a69f6dd6c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.297168 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-244e722d-b8a5-4265-ae4e-00922623c200 req-67657022-5ef4-4aad-b2f9-912c9f6b4dd4 service nova] Creating event network-changed:b0f73b8a-a342-4961-8be0-cc1c0a325389 for instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd on hv-cinder-85001 Jul 18 02:46:10.302242 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-244e722d-b8a5-4265-ae4e-00922623c200 req-67657022-5ef4-4aad-b2f9-912c9f6b4dd4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036305 Jul 18 02:46:10.302840 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 566/1130] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:10.310005 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-cde15b09-0ff1-4a62-bf17-82632a4aefb0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:10.310741 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-cde15b09-0ff1-4a62-bf17-82632a4aefb0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:10.313360 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2968cf04-855b-46b4-9499-3f2a69f6dd6c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:46:10.317233 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cde15b09-0ff1-4a62-bf17-82632a4aefb0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.317683 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cde15b09-0ff1-4a62-bf17-82632a4aefb0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.318477 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cde15b09-0ff1-4a62-bf17-82632a4aefb0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.319022 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-cde15b09-0ff1-4a62-bf17-82632a4aefb0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.450671 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-cde15b09-0ff1-4a62-bf17-82632a4aefb0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:10.458144 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-cde15b09-0ff1-4a62-bf17-82632a4aefb0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1513 microversion: 2.1 time: 0.153360 Jul 18 02:46:10.458713 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 567/1131] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:10 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:10.463761 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c3aaaf1c-364a-4cba-a2e3-a21bd48c317a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:10.465098 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c3aaaf1c-364a-4cba-a2e3-a21bd48c317a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:10.471315 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3aaaf1c-364a-4cba-a2e3-a21bd48c317a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.471765 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3aaaf1c-364a-4cba-a2e3-a21bd48c317a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.472530 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3aaaf1c-364a-4cba-a2e3-a21bd48c317a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.472967 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3aaaf1c-364a-4cba-a2e3-a21bd48c317a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.648031 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c3aaaf1c-364a-4cba-a2e3-a21bd48c317a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:10.656419 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c3aaaf1c-364a-4cba-a2e3-a21bd48c317a tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.196712 Jul 18 02:46:10.657000 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 568/1132] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:10 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:10.713772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2968cf04-855b-46b4-9499-3f2a69f6dd6c tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 204 len: 0 microversion: 2.1 time: 0.450038 Jul 18 02:46:10.714401 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 565/1133] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:46:10 2022] DELETE /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:46:10.722540 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-376ce681-ebe0-424c-a21d-91fcb17706a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:10.729771 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-376ce681-ebe0-424c-a21d-91fcb17706a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:10.729922 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-376ce681-ebe0-424c-a21d-91fcb17706a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.730431 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-376ce681-ebe0-424c-a21d-91fcb17706a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.731173 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-376ce681-ebe0-424c-a21d-91fcb17706a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:10.731605 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-376ce681-ebe0-424c-a21d-91fcb17706a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:10.735638 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:10.866051 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-376ce681-ebe0-424c-a21d-91fcb17706a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:10.873533 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-376ce681-ebe0-424c-a21d-91fcb17706a2 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1577 microversion: 2.1 time: 0.154766 Jul 18 02:46:10.874126 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 569/1134] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:10 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:11.475801 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a836519c-a380-43d5-a339-ad0c64b60fa5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:11.476424 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a836519c-a380-43d5-a339-ad0c64b60fa5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:11.483109 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a836519c-a380-43d5-a339-ad0c64b60fa5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.483562 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a836519c-a380-43d5-a339-ad0c64b60fa5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.484330 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a836519c-a380-43d5-a339-ad0c64b60fa5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.484772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a836519c-a380-43d5-a339-ad0c64b60fa5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.614354 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a836519c-a380-43d5-a339-ad0c64b60fa5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:11.622325 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a836519c-a380-43d5-a339-ad0c64b60fa5 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1513 microversion: 2.1 time: 0.150959 Jul 18 02:46:11.628138 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 566/1135] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:11 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:11.674715 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-1c15fe00-0287-47ee-b7ba-7c86fe215364 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:11.675333 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-1c15fe00-0287-47ee-b7ba-7c86fe215364 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:11.682784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c15fe00-0287-47ee-b7ba-7c86fe215364 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.683241 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c15fe00-0287-47ee-b7ba-7c86fe215364 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.684034 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c15fe00-0287-47ee-b7ba-7c86fe215364 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.684482 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-1c15fe00-0287-47ee-b7ba-7c86fe215364 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.829087 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-1c15fe00-0287-47ee-b7ba-7c86fe215364 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:11.837361 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-1c15fe00-0287-47ee-b7ba-7c86fe215364 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.166508 Jul 18 02:46:11.837931 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 570/1136] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:11 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:11.890433 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-a37470c4-1861-4917-8357-3774e793c32d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:11.891039 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-a37470c4-1861-4917-8357-3774e793c32d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:11.897023 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a37470c4-1861-4917-8357-3774e793c32d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.897467 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a37470c4-1861-4917-8357-3774e793c32d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:11.898656 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a37470c4-1861-4917-8357-3774e793c32d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:11.899094 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-a37470c4-1861-4917-8357-3774e793c32d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:12.027078 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-a37470c4-1861-4917-8357-3774e793c32d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:12.034580 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-a37470c4-1861-4917-8357-3774e793c32d tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1577 microversion: 2.1 time: 0.148082 Jul 18 02:46:12.035142 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 567/1137] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:11 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:12.639597 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b3ccc5ac-5aab-4f12-a37a-7c09f42ce896 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:12.640211 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b3ccc5ac-5aab-4f12-a37a-7c09f42ce896 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:12.646245 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b3ccc5ac-5aab-4f12-a37a-7c09f42ce896 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:12.646692 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b3ccc5ac-5aab-4f12-a37a-7c09f42ce896 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:12.647455 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b3ccc5ac-5aab-4f12-a37a-7c09f42ce896 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:12.648637 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b3ccc5ac-5aab-4f12-a37a-7c09f42ce896 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:12.789661 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-b3ccc5ac-5aab-4f12-a37a-7c09f42ce896 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:12.798112 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b3ccc5ac-5aab-4f12-a37a-7c09f42ce896 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1513 microversion: 2.1 time: 0.162402 Jul 18 02:46:12.799634 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 571/1138] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:12 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:12.854901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-6fbcc000-7a53-4af6-a730-e5b5e72589d3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:12.856011 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-6fbcc000-7a53-4af6-a730-e5b5e72589d3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:12.862109 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6fbcc000-7a53-4af6-a730-e5b5e72589d3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:12.862517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6fbcc000-7a53-4af6-a730-e5b5e72589d3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:12.863274 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6fbcc000-7a53-4af6-a730-e5b5e72589d3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:12.863707 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-6fbcc000-7a53-4af6-a730-e5b5e72589d3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.052230 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-d71eba6c-85a7-4311-b43b-aadd097798ed tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:13.053159 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-d71eba6c-85a7-4311-b43b-aadd097798ed tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:13.059860 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d71eba6c-85a7-4311-b43b-aadd097798ed tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.060301 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d71eba6c-85a7-4311-b43b-aadd097798ed tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.061565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d71eba6c-85a7-4311-b43b-aadd097798ed tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.061565 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-d71eba6c-85a7-4311-b43b-aadd097798ed tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.174576 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-6fbcc000-7a53-4af6-a730-e5b5e72589d3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:13.183564 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-6fbcc000-7a53-4af6-a730-e5b5e72589d3 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.333016 Jul 18 02:46:13.193940 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 568/1139] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:12 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:13.203739 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-d71eba6c-85a7-4311-b43b-aadd097798ed tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:13.212182 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-d71eba6c-85a7-4311-b43b-aadd097798ed tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1577 microversion: 2.1 time: 0.163807 Jul 18 02:46:13.212811 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 572/1140] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:13 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:13.578914 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-33fc1a66-5f57-4b24-a2bf-04c5134b6ffd req-68755754-17ab-4fb9-8afa-4cbc769c48f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082cd7d7-4392-4d0c-a2ba-33d0f875e18a", "name": "network-vif-deleted", "tag": "0dc810cf-7837-4639-b458-b2ef55fd55a4"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:13.589590 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-33fc1a66-5f57-4b24-a2bf-04c5134b6ffd req-68755754-17ab-4fb9-8afa-4cbc769c48f5 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.590335 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-33fc1a66-5f57-4b24-a2bf-04c5134b6ffd req-68755754-17ab-4fb9-8afa-4cbc769c48f5 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.602616 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-33fc1a66-5f57-4b24-a2bf-04c5134b6ffd req-68755754-17ab-4fb9-8afa-4cbc769c48f5 service nova] Creating event network-vif-deleted:0dc810cf-7837-4639-b458-b2ef55fd55a4 for instance 082cd7d7-4392-4d0c-a2ba-33d0f875e18a on hv-cinder-85001 Jul 18 02:46:13.617311 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-33fc1a66-5f57-4b24-a2bf-04c5134b6ffd req-68755754-17ab-4fb9-8afa-4cbc769c48f5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037117 Jul 18 02:46:13.617311 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 569/1141] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:13.817041 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-5e8582d4-849a-4c68-8867-40eba99603c0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:13.817658 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-5e8582d4-849a-4c68-8867-40eba99603c0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:13.824859 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5e8582d4-849a-4c68-8867-40eba99603c0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.825314 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5e8582d4-849a-4c68-8867-40eba99603c0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.826118 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5e8582d4-849a-4c68-8867-40eba99603c0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:13.826733 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-5e8582d4-849a-4c68-8867-40eba99603c0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:13.896241 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-5e8582d4-849a-4c68-8867-40eba99603c0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:13.904209 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-5e8582d4-849a-4c68-8867-40eba99603c0 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1303 microversion: 2.1 time: 0.091269 Jul 18 02:46:13.904789 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 573/1142] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:13 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:14.202718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8aed8d2d-509c-415c-961f-ca9f375d509e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:14.202718 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8aed8d2d-509c-415c-961f-ca9f375d509e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:14.212221 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8aed8d2d-509c-415c-961f-ca9f375d509e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:14.212674 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8aed8d2d-509c-415c-961f-ca9f375d509e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:14.213455 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8aed8d2d-509c-415c-961f-ca9f375d509e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:14.213896 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8aed8d2d-509c-415c-961f-ca9f375d509e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:14.219324 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:14.229917 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-01d0e574-93f5-40c7-9024-5fb132508636 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:14.230616 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-01d0e574-93f5-40c7-9024-5fb132508636 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:14.239939 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-01d0e574-93f5-40c7-9024-5fb132508636 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:14.240392 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-01d0e574-93f5-40c7-9024-5fb132508636 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:14.241164 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-01d0e574-93f5-40c7-9024-5fb132508636 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:14.246071 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-01d0e574-93f5-40c7-9024-5fb132508636 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:14.311064 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-01d0e574-93f5-40c7-9024-5fb132508636 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:14.319555 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-01d0e574-93f5-40c7-9024-5fb132508636 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1391 microversion: 2.1 time: 0.094235 Jul 18 02:46:14.320378 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 574/1143] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:14 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1391 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:14.382030 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8aed8d2d-509c-415c-961f-ca9f375d509e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:14.389838 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8aed8d2d-509c-415c-961f-ca9f375d509e tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.192550 Jul 18 02:46:14.390426 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 570/1144] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:14 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:14.920892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:14.926521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:14.928588 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:14.929141 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:14.930161 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:14.930664 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:14.965374 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:14.965912 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:14.966470 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lazy-loading 'fault' on Instance uuid 082cd7d7-4392-4d0c-a2ba-33d0f875e18a {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:46:15.001264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-785f8a3d-ec37-4ec3-b0f0-6e8217f6cc65 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:15.001957 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-785f8a3d-ec37-4ec3-b0f0-6e8217f6cc65 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:15.009490 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b065087a79524114b5cacb8c5fd3254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2b132c879f4f5e90593713a3f472c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:15.009671 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-785f8a3d-ec37-4ec3-b0f0-6e8217f6cc65 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.010106 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-785f8a3d-ec37-4ec3-b0f0-6e8217f6cc65 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.010925 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-785f8a3d-ec37-4ec3-b0f0-6e8217f6cc65 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.011449 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-785f8a3d-ec37-4ec3-b0f0-6e8217f6cc65 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.018109 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-11c03ba1-a357-4247-aadf-b4ca9fa01a48 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 200 len: 1308 microversion: 2.1 time: 0.101086 Jul 18 02:46:15.018814 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 575/1145] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:14 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:15.038523 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-785f8a3d-ec37-4ec3-b0f0-6e8217f6cc65 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lazy-loading 'flavor' on Instance uuid e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:46:15.336254 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:15.336903 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:15.342848 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.343297 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.344065 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.344501 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.376765 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.377218 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.377681 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.objects.instance [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lazy-loading 'fault' on Instance uuid 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd {{(pid=124890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:46:15.420036 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a452eca3af46b09f56a80fa8652247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807f88779cf842f3bbe09615d470f44c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:15.427914 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-15620ae3-692a-4842-9897-c3a7cb90c5fc tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 200 len: 1230 microversion: 2.1 time: 0.095641 Jul 18 02:46:15.429801 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 576/1146] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:15 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:15.433335 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a3a4a185-deac-4a00-a671-47e7b47e8408 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:15.433936 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a3a4a185-deac-4a00-a671-47e7b47e8408 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:15.439758 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3a4a185-deac-4a00-a671-47e7b47e8408 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.440386 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-785f8a3d-ec37-4ec3-b0f0-6e8217f6cc65 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "POST /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39/action" status: 202 len: 0 microversion: 2.1 time: 0.443261 Jul 18 02:46:15.441345 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3a4a185-deac-4a00-a671-47e7b47e8408 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.441529 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 571/1147] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:46:14 2022] POST /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:46:15.442501 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3a4a185-deac-4a00-a671-47e7b47e8408 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.443094 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a3a4a185-deac-4a00-a671-47e7b47e8408 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.451136 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0d486384-ca12-43e8-be93-c5d511f79041 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:15.452013 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0d486384-ca12-43e8-be93-c5d511f79041 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:15.458621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0d486384-ca12-43e8-be93-c5d511f79041 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.459148 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0d486384-ca12-43e8-be93-c5d511f79041 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.460188 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0d486384-ca12-43e8-be93-c5d511f79041 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.460863 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0d486384-ca12-43e8-be93-c5d511f79041 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.595165 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0d486384-ca12-43e8-be93-c5d511f79041 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:15.599553 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-a3a4a185-deac-4a00-a671-47e7b47e8408 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:15.603731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0d486384-ca12-43e8-be93-c5d511f79041 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.156729 Jul 18 02:46:15.604542 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 572/1148] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:15 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:15.608490 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a3a4a185-deac-4a00-a671-47e7b47e8408 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.178508 Jul 18 02:46:15.609135 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 577/1149] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:15 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:15.627140 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-e44ee549-c4e1-4632-8343-4e1554e29b03 req-feb179bd-05c7-434e-b208-9fd1e65319a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d47ffd3-9df5-400c-8cef-efcc7d6d97cd", "name": "network-vif-deleted", "tag": "b0f73b8a-a342-4961-8be0-cc1c0a325389"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:15.635202 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-e44ee549-c4e1-4632-8343-4e1554e29b03 req-feb179bd-05c7-434e-b208-9fd1e65319a0 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:15.635644 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-e44ee549-c4e1-4632-8343-4e1554e29b03 req-feb179bd-05c7-434e-b208-9fd1e65319a0 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:15.646057 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-e44ee549-c4e1-4632-8343-4e1554e29b03 req-feb179bd-05c7-434e-b208-9fd1e65319a0 service nova] Creating event network-vif-deleted:b0f73b8a-a342-4961-8be0-cc1c0a325389 for instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd on hv-cinder-85001 Jul 18 02:46:15.651033 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-e44ee549-c4e1-4632-8343-4e1554e29b03 req-feb179bd-05c7-434e-b208-9fd1e65319a0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027597 Jul 18 02:46:15.651594 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 573/1150] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:46:16.040972 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6ea80ab3-085d-46f8-83ab-4943841c6643 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:16.041760 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6ea80ab3-085d-46f8-83ab-4943841c6643 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] [instance: 082cd7d7-4392-4d0c-a2ba-33d0f875e18a] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:16.048458 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6ea80ab3-085d-46f8-83ab-4943841c6643 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.048916 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6ea80ab3-085d-46f8-83ab-4943841c6643 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.049707 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6ea80ab3-085d-46f8-83ab-4943841c6643 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.050173 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6ea80ab3-085d-46f8-83ab-4943841c6643 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.063581 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-6ea80ab3-085d-46f8-83ab-4943841c6643 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] HTTP exception thrown: Instance 082cd7d7-4392-4d0c-a2ba-33d0f875e18a could not be found. Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6ea80ab3-085d-46f8-83ab-4943841c6643 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Request method failure captured: Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a HTTP/1.1 Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MjvODvDxUYO7SEHt-XJTVLZqULy2ShpUM2NujoAITVCYZvqQ9nOW6NFBsIbJiNbhp2LyqJ-rNO3oD5gPAHBJeQ7VrjWtqo5aaNVhS7-CeQPX-BXDdUBFz3N9I3mHHUp-L8QtISzB4u199yCV6egk8YntE936qu1CW-jqitfBKBKO6g Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: ad2b132c879f4f5e90593713a3f472c1 Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1261081327 Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:46:16.065260 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ad2b132c879f4f5e90593713a3f472c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ad2b132c879f4f5e90593713a3f472c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ad2b132c879f4f5e90593713a3f472c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ad2b132c879f4f5e90593713a3f472c1", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-VolumesSnapshotTestJSON-1261081327 Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: ad2b132c879f4f5e90593713a3f472c1 Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1261081327 Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-VolumesSnapshotTestJSON-1261081327-project Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: b065087a79524114b5cacb8c5fd3254f Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-VolumesSnapshotTestJSON-1261081327-project Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance 082cd7d7-4392-4d0c-a2ba-33d0f875e18a could not be found. Jul 18 02:46:16.067398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': '082cd7d7-4392-4d0c-a2ba-33d0f875e18a'} Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082cd7d7-4392-4d0c-a2ba-33d0f875e18a could not be found. Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:16.068270 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082cd7d7-4392-4d0c-a2ba-33d0f875e18a could not be found. Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082cd7d7-4392-4d0c-a2ba-33d0f875e18a could not be found. Jul 18 02:46:16.069839 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:16.071261 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6ea80ab3-085d-46f8-83ab-4943841c6643 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] Returning 404 to user: Instance 082cd7d7-4392-4d0c-a2ba-33d0f875e18a could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:16.071261 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6ea80ab3-085d-46f8-83ab-4943841c6643 tempest-VolumesSnapshotTestJSON-1261081327 tempest-VolumesSnapshotTestJSON-1261081327-project] 10.222.0.66 "GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a" status: 404 len: 111 microversion: 2.1 time: 0.030370 Jul 18 02:46:16.071261 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 578/1151] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:16 2022] GET /compute/v2.1/servers/082cd7d7-4392-4d0c-a2ba-33d0f875e18a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:46:16.448107 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-01534a62-de91-4541-a4db-0abde2ae56f6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:16.448809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-01534a62-de91-4541-a4db-0abde2ae56f6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:16.454979 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01534a62-de91-4541-a4db-0abde2ae56f6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.455435 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01534a62-de91-4541-a4db-0abde2ae56f6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.456208 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01534a62-de91-4541-a4db-0abde2ae56f6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.456651 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-01534a62-de91-4541-a4db-0abde2ae56f6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.470614 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-01534a62-de91-4541-a4db-0abde2ae56f6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] HTTP exception thrown: Instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd could not be found. Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-01534a62-de91-4541-a4db-0abde2ae56f6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Request method failure captured: Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd HTTP/1.1 Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MdxaPdbAazZUjAbFLfDD-BhuS0wZmHyZWnJFNNV8MI8fuxJbmVympsiuxnwmNE6ch6KfpCH1DYfIbYNTqQHTFyHLN2g8HbEiWT8ZIoav6ekZ_p8oN_jjSHxG9I2rbxTRlMVA0GzZ8cfv75mbVYcFrrffaqPLaVo0JMbLozvzr75mNs Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 807f88779cf842f3bbe09615d470f44c Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:46:16.472264 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_807f88779cf842f3bbe09615d470f44c", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 807f88779cf842f3bbe09615d470f44c Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-TestVolumeBootPattern-1838735271-project Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 41a452eca3af46b09f56a80fa8652247 Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-TestVolumeBootPattern-1838735271-project Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd could not be found. Jul 18 02:46:16.474009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': '6d47ffd3-9df5-400c-8cef-efcc7d6d97cd'} Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd could not be found. Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:16.475774 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd could not be found. Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd could not be found. Jul 18 02:46:16.477411 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:16.479292 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-01534a62-de91-4541-a4db-0abde2ae56f6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Returning 404 to user: Instance 6d47ffd3-9df5-400c-8cef-efcc7d6d97cd could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:16.479292 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-01534a62-de91-4541-a4db-0abde2ae56f6 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd" status: 404 len: 111 microversion: 2.1 time: 0.030958 Jul 18 02:46:16.479292 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 574/1152] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:16 2022] GET /compute/v2.1/servers/6d47ffd3-9df5-400c-8cef-efcc7d6d97cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:46:16.625599 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-32b6989d-d48d-4378-980a-9442f6734fcc tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:16.626233 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-32b6989d-d48d-4378-980a-9442f6734fcc tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:16.628379 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-8d05ba67-969a-4cee-94e5-ea37d574161e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:16.628993 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-8d05ba67-969a-4cee-94e5-ea37d574161e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:16.642492 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8d05ba67-969a-4cee-94e5-ea37d574161e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.642492 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8d05ba67-969a-4cee-94e5-ea37d574161e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.642492 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8d05ba67-969a-4cee-94e5-ea37d574161e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.642492 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-8d05ba67-969a-4cee-94e5-ea37d574161e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.645923 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32b6989d-d48d-4378-980a-9442f6734fcc tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.646418 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32b6989d-d48d-4378-980a-9442f6734fcc tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.647197 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32b6989d-d48d-4378-980a-9442f6734fcc tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:16.647802 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-32b6989d-d48d-4378-980a-9442f6734fcc tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:16.802433 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-32b6989d-d48d-4378-980a-9442f6734fcc tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:16.812505 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-32b6989d-d48d-4378-980a-9442f6734fcc tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1755 microversion: 2.1 time: 0.190554 Jul 18 02:46:16.813429 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 575/1153] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:16 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:16.818905 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-8d05ba67-969a-4cee-94e5-ea37d574161e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:16.828379 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-8d05ba67-969a-4cee-94e5-ea37d574161e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.210134 Jul 18 02:46:16.828546 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 579/1154] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:16 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:17.122329 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2b1f0a81-ca39-4a67-8a93-6346778be302 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:17.122833 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-2b1f0a81-ca39-4a67-8a93-6346778be302 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:17.128938 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b1f0a81-ca39-4a67-8a93-6346778be302 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:17.129393 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b1f0a81-ca39-4a67-8a93-6346778be302 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.130198 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b1f0a81-ca39-4a67-8a93-6346778be302 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:17.130644 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-2b1f0a81-ca39-4a67-8a93-6346778be302 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.144198 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.wsgi [None req-2b1f0a81-ca39-4a67-8a93-6346778be302 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] HTTP exception thrown: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2b1f0a81-ca39-4a67-8a93-6346778be302 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Request method failure captured: Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: request: DELETE /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 HTTP/1.1 Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept: application/json Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Accept-Encoding: identity Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Connection: close Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Length: 0 Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Content-Type: application/json Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Host: 10.222.0.66 Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Openstack-System-Scope: None Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Auth-Token: gAAAAABi1MdxaPdbAazZUjAbFLfDD-BhuS0wZmHyZWnJFNNV8MI8fuxJbmVympsiuxnwmNE6ch6KfpCH1DYfIbYNTqQHTFyHLN2g8HbEiWT8ZIoav6ekZ_p8oN_jjSHxG9I2rbxTRlMVA0GzZ8cfv75mbVYcFrrffaqPLaVo0JMbLozvzr75mNs Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Id: None Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Domain-Name: None Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Identity-Status: Confirmed Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Is-Admin-Project: True Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Id: default Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Domain-Name: Default Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Id: 807f88779cf842f3bbe09615d470f44c Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Project-Name: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Role: member,reader Jul 18 02:46:17.145741 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Roles: member,reader Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_807f88779cf842f3bbe09615d470f44c", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Id: 807f88779cf842f3bbe09615d470f44c Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-Tenant-Name: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User: tempest-TestVolumeBootPattern-1838735271-project Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Id: default Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Domain-Name: Default Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Id: 41a452eca3af46b09f56a80fa8652247 Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: X-User-Name: tempest-TestVolumeBootPattern-1838735271-project Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: method: > Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: exception: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:46:17.150690 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: action_args: {'id': 'fb7697d1-40ec-4c17-979a-de45d737eac5'} Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:17.151638 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:46:17.153206 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: ERROR nova.api.openstack.wsgi Jul 18 02:46:17.154816 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2b1f0a81-ca39-4a67-8a93-6346778be302 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Returning 404 to user: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. {{(pid=124891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:17.154816 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2b1f0a81-ca39-4a67-8a93-6346778be302 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 404 len: 111 microversion: 2.1 time: 0.028754 Jul 18 02:46:17.154816 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 576/1155] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:46:17 2022] DELETE /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:46:17.156099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-30d781dd-8bd3-4c96-8d5f-5aed435bd956 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:17.156748 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-30d781dd-8bd3-4c96-8d5f-5aed435bd956 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] [instance: fb7697d1-40ec-4c17-979a-de45d737eac5] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:17.163804 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-30d781dd-8bd3-4c96-8d5f-5aed435bd956 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:17.164284 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-30d781dd-8bd3-4c96-8d5f-5aed435bd956 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.165040 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-30d781dd-8bd3-4c96-8d5f-5aed435bd956 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:17.165477 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-30d781dd-8bd3-4c96-8d5f-5aed435bd956 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.179554 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-30d781dd-8bd3-4c96-8d5f-5aed435bd956 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] HTTP exception thrown: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-30d781dd-8bd3-4c96-8d5f-5aed435bd956 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Request method failure captured: Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 HTTP/1.1 Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MdxaPdbAazZUjAbFLfDD-BhuS0wZmHyZWnJFNNV8MI8fuxJbmVympsiuxnwmNE6ch6KfpCH1DYfIbYNTqQHTFyHLN2g8HbEiWT8ZIoav6ekZ_p8oN_jjSHxG9I2rbxTRlMVA0GzZ8cfv75mbVYcFrrffaqPLaVo0JMbLozvzr75mNs Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 807f88779cf842f3bbe09615d470f44c Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:46:17.184213 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/807f88779cf842f3bbe09615d470f44c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_807f88779cf842f3bbe09615d470f44c", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 807f88779cf842f3bbe09615d470f44c Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-TestVolumeBootPattern-1838735271 Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-TestVolumeBootPattern-1838735271-project Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 41a452eca3af46b09f56a80fa8652247 Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-TestVolumeBootPattern-1838735271-project Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:46:17.185892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'fb7697d1-40ec-4c17-979a-de45d737eac5'} Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:17.186849 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. Jul 18 02:46:17.188402 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:17.189784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-30d781dd-8bd3-4c96-8d5f-5aed435bd956 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Returning 404 to user: Instance fb7697d1-40ec-4c17-979a-de45d737eac5 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:17.189784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-30d781dd-8bd3-4c96-8d5f-5aed435bd956 tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5" status: 404 len: 111 microversion: 2.1 time: 0.030384 Jul 18 02:46:17.189784 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 580/1156] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:17 2022] GET /compute/v2.1/servers/fb7697d1-40ec-4c17-979a-de45d737eac5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:46:17.831091 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3838aa95-b195-4173-96aa-ca5ab737bd06 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:17.831713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3838aa95-b195-4173-96aa-ca5ab737bd06 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:17.841278 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3838aa95-b195-4173-96aa-ca5ab737bd06 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:17.841278 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3838aa95-b195-4173-96aa-ca5ab737bd06 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.841721 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3838aa95-b195-4173-96aa-ca5ab737bd06 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:17.842093 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3838aa95-b195-4173-96aa-ca5ab737bd06 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.845380 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-38b99bf4-10cf-4eb4-b237-9ff7fc9c85a1 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:17.846058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-38b99bf4-10cf-4eb4-b237-9ff7fc9c85a1 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:17.853277 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-38b99bf4-10cf-4eb4-b237-9ff7fc9c85a1 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:17.853755 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-38b99bf4-10cf-4eb4-b237-9ff7fc9c85a1 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.854558 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-38b99bf4-10cf-4eb4-b237-9ff7fc9c85a1 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:17.854998 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-38b99bf4-10cf-4eb4-b237-9ff7fc9c85a1 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:17.994044 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3838aa95-b195-4173-96aa-ca5ab737bd06 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:17.997486 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-38b99bf4-10cf-4eb4-b237-9ff7fc9c85a1 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:18.002338 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3838aa95-b195-4173-96aa-ca5ab737bd06 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1758 microversion: 2.1 time: 0.175196 Jul 18 02:46:18.002916 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 577/1157] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:17 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:18.005657 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-38b99bf4-10cf-4eb4-b237-9ff7fc9c85a1 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.164056 Jul 18 02:46:18.006253 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 581/1158] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:17 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:18.701740 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-5f0de90a-c10c-4bf7-821f-ff477c9e675b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] Calling method '.version_select at 0x7f28ee5fdca0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:18.806309 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-5f0de90a-c10c-4bf7-821f-ff477c9e675b tempest-TestVolumeBootPattern-1838735271 tempest-TestVolumeBootPattern-1838735271-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-530523020" status: 202 len: 0 microversion: 2.1 time: 0.108332 Jul 18 02:46:18.806900 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 578/1159] 10.222.0.66 () {58 vars in 1259 bytes} [Mon Jul 18 02:46:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-530523020 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:46:19.023114 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-0561e844-5f4b-4b96-9d3f-5c71c16d4272 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:19.023813 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-0561e844-5f4b-4b96-9d3f-5c71c16d4272 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:19.030595 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0561e844-5f4b-4b96-9d3f-5c71c16d4272 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:19.031112 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0561e844-5f4b-4b96-9d3f-5c71c16d4272 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:19.031935 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0561e844-5f4b-4b96-9d3f-5c71c16d4272 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:19.032494 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-0561e844-5f4b-4b96-9d3f-5c71c16d4272 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:19.255178 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-0561e844-5f4b-4b96-9d3f-5c71c16d4272 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:19.262819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-0561e844-5f4b-4b96-9d3f-5c71c16d4272 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.243807 Jul 18 02:46:19.263373 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 582/1160] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:19 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:20.280211 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-0407b10e-800e-4f72-995e-1dd763972474 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:20.281427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-0407b10e-800e-4f72-995e-1dd763972474 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:20.287635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0407b10e-800e-4f72-995e-1dd763972474 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:20.288391 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0407b10e-800e-4f72-995e-1dd763972474 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:20.289337 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0407b10e-800e-4f72-995e-1dd763972474 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:20.289918 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-0407b10e-800e-4f72-995e-1dd763972474 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:20.425860 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-0407b10e-800e-4f72-995e-1dd763972474 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:20.434275 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-0407b10e-800e-4f72-995e-1dd763972474 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.158457 Jul 18 02:46:20.434864 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 579/1161] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:20 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:21.451315 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-648cda70-5401-4efb-8d02-bf948896885f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:21.451945 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-648cda70-5401-4efb-8d02-bf948896885f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:21.458544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-648cda70-5401-4efb-8d02-bf948896885f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:21.459023 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-648cda70-5401-4efb-8d02-bf948896885f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:21.463366 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-648cda70-5401-4efb-8d02-bf948896885f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:21.463366 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-648cda70-5401-4efb-8d02-bf948896885f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:21.596502 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-648cda70-5401-4efb-8d02-bf948896885f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:21.605773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-648cda70-5401-4efb-8d02-bf948896885f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.158224 Jul 18 02:46:21.608607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 583/1162] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:21 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:22.623269 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d11aa13f-4809-442f-b781-ce4857ad5a72 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:22.623894 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d11aa13f-4809-442f-b781-ce4857ad5a72 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:22.631074 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d11aa13f-4809-442f-b781-ce4857ad5a72 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:22.633397 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d11aa13f-4809-442f-b781-ce4857ad5a72 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:22.633397 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d11aa13f-4809-442f-b781-ce4857ad5a72 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:22.633397 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d11aa13f-4809-442f-b781-ce4857ad5a72 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:22.980370 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d11aa13f-4809-442f-b781-ce4857ad5a72 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:22.988398 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d11aa13f-4809-442f-b781-ce4857ad5a72 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.369016 Jul 18 02:46:22.988969 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 580/1163] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:22 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:24.006006 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-816351d6-14dc-49ec-abcb-cc86fa56fc88 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:24.007484 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-816351d6-14dc-49ec-abcb-cc86fa56fc88 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:24.014288 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-816351d6-14dc-49ec-abcb-cc86fa56fc88 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:24.014745 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-816351d6-14dc-49ec-abcb-cc86fa56fc88 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:24.015689 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-816351d6-14dc-49ec-abcb-cc86fa56fc88 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:24.016132 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-816351d6-14dc-49ec-abcb-cc86fa56fc88 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:24.286211 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-816351d6-14dc-49ec-abcb-cc86fa56fc88 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:24.294550 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-816351d6-14dc-49ec-abcb-cc86fa56fc88 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.292303 Jul 18 02:46:24.295211 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 584/1164] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:24 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:25.312563 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-168ab9d9-a348-4572-9d67-eeac2616e464 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:25.313963 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-168ab9d9-a348-4572-9d67-eeac2616e464 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:25.321772 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-168ab9d9-a348-4572-9d67-eeac2616e464 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:25.324589 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-168ab9d9-a348-4572-9d67-eeac2616e464 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:25.324589 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-168ab9d9-a348-4572-9d67-eeac2616e464 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:25.324589 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-168ab9d9-a348-4572-9d67-eeac2616e464 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:25.482607 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-168ab9d9-a348-4572-9d67-eeac2616e464 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:25.492019 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-168ab9d9-a348-4572-9d67-eeac2616e464 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.183095 Jul 18 02:46:25.492666 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 581/1165] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:25 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:26.509526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-044da5e7-f50c-4ade-b262-614f07511004 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:26.510057 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-044da5e7-f50c-4ade-b262-614f07511004 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:26.516695 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-044da5e7-f50c-4ade-b262-614f07511004 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:26.517099 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-044da5e7-f50c-4ade-b262-614f07511004 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:26.517875 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-044da5e7-f50c-4ade-b262-614f07511004 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:26.518340 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-044da5e7-f50c-4ade-b262-614f07511004 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:26.775547 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-044da5e7-f50c-4ade-b262-614f07511004 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:26.783369 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-044da5e7-f50c-4ade-b262-614f07511004 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.278505 Jul 18 02:46:26.783962 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 585/1166] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:26 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:27.800826 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-d9c0e4b2-7dc2-4103-b134-e0ccc42c7d7f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:27.801457 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-d9c0e4b2-7dc2-4103-b134-e0ccc42c7d7f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:27.808628 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9c0e4b2-7dc2-4103-b134-e0ccc42c7d7f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:27.809083 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9c0e4b2-7dc2-4103-b134-e0ccc42c7d7f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:27.809850 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9c0e4b2-7dc2-4103-b134-e0ccc42c7d7f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:27.810323 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-d9c0e4b2-7dc2-4103-b134-e0ccc42c7d7f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:27.952837 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-d9c0e4b2-7dc2-4103-b134-e0ccc42c7d7f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:27.961226 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-d9c0e4b2-7dc2-4103-b134-e0ccc42c7d7f tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.164343 Jul 18 02:46:27.961887 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 582/1167] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:27 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:28.978856 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c3af2844-fd19-431d-a2f8-96bf214a9ba9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:28.980491 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c3af2844-fd19-431d-a2f8-96bf214a9ba9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:28.982989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:28.988293 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3af2844-fd19-431d-a2f8-96bf214a9ba9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:28.988591 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3af2844-fd19-431d-a2f8-96bf214a9ba9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:28.989362 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3af2844-fd19-431d-a2f8-96bf214a9ba9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:28.989831 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3af2844-fd19-431d-a2f8-96bf214a9ba9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:29.009039 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=100 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:29.127174 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c3af2844-fd19-431d-a2f8-96bf214a9ba9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:29.135996 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c3af2844-fd19-431d-a2f8-96bf214a9ba9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.161554 Jul 18 02:46:29.136594 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 586/1168] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:28 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:30.152834 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-774d61cf-1cf4-4f99-8b5c-32379c88f021 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:30.153452 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-774d61cf-1cf4-4f99-8b5c-32379c88f021 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:30.156050 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:30.160859 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-774d61cf-1cf4-4f99-8b5c-32379c88f021 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:30.161307 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-774d61cf-1cf4-4f99-8b5c-32379c88f021 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:30.162068 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-774d61cf-1cf4-4f99-8b5c-32379c88f021 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:30.162595 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-774d61cf-1cf4-4f99-8b5c-32379c88f021 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:30.298243 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-774d61cf-1cf4-4f99-8b5c-32379c88f021 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:30.309622 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-774d61cf-1cf4-4f99-8b5c-32379c88f021 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.160760 Jul 18 02:46:30.310229 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 583/1169] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:30 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:31.327536 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-83bdf47a-298a-442a-a1ed-4dbbec970c31 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:31.328190 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-83bdf47a-298a-442a-a1ed-4dbbec970c31 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:31.336816 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83bdf47a-298a-442a-a1ed-4dbbec970c31 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:31.337264 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83bdf47a-298a-442a-a1ed-4dbbec970c31 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:31.338060 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83bdf47a-298a-442a-a1ed-4dbbec970c31 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:31.338521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-83bdf47a-298a-442a-a1ed-4dbbec970c31 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:31.471507 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-83bdf47a-298a-442a-a1ed-4dbbec970c31 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:31.480115 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-83bdf47a-298a-442a-a1ed-4dbbec970c31 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.156320 Jul 18 02:46:31.480691 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 587/1170] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:31 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:32.497390 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-c0db3ca8-d10c-4bd6-94a6-5fa215d3ab85 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:32.498134 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-c0db3ca8-d10c-4bd6-94a6-5fa215d3ab85 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:32.504553 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c0db3ca8-d10c-4bd6-94a6-5fa215d3ab85 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.505005 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c0db3ca8-d10c-4bd6-94a6-5fa215d3ab85 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.505770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c0db3ca8-d10c-4bd6-94a6-5fa215d3ab85 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.506907 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-c0db3ca8-d10c-4bd6-94a6-5fa215d3ab85 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.644763 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-c0db3ca8-d10c-4bd6-94a6-5fa215d3ab85 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:32.652785 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-c0db3ca8-d10c-4bd6-94a6-5fa215d3ab85 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1508 microversion: 2.1 time: 0.159323 Jul 18 02:46:32.653419 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 584/1171] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:32 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:32.670438 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-40a125b9-3d61-4438-9514-8f3706214f87 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:32.676317 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-40a125b9-3d61-4438-9514-8f3706214f87 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:32.677013 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-40a125b9-3d61-4438-9514-8f3706214f87 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.677466 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-40a125b9-3d61-4438-9514-8f3706214f87 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.678899 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-40a125b9-3d61-4438-9514-8f3706214f87 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.679355 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-40a125b9-3d61-4438-9514-8f3706214f87 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.821659 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-596f9f19-3aef-4656-947c-aaa3bd9610dd req-7a9a65e8-201d-43cf-8d6e-5f74f5c89124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39", "name": "network-vif-unplugged", "status": "completed", "tag": "5fd8b9bf-0dc7-4030-8d82-774afb4914af"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:32.829453 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-596f9f19-3aef-4656-947c-aaa3bd9610dd req-7a9a65e8-201d-43cf-8d6e-5f74f5c89124 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:32.829893 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-596f9f19-3aef-4656-947c-aaa3bd9610dd req-7a9a65e8-201d-43cf-8d6e-5f74f5c89124 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:32.841240 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.compute.server_external_events [req-596f9f19-3aef-4656-947c-aaa3bd9610dd req-7a9a65e8-201d-43cf-8d6e-5f74f5c89124 service nova] Unable to find a host for instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39. Dropping event network-vif-unplugged {{(pid=124890) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 02:46:32.859841 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-596f9f19-3aef-4656-947c-aaa3bd9610dd req-7a9a65e8-201d-43cf-8d6e-5f74f5c89124 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.204606 Jul 18 02:46:32.859841 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 588/1172] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 206 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 02:46:33.137831 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-40a125b9-3d61-4438-9514-8f3706214f87 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "POST /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39/action" status: 202 len: 0 microversion: 2.1 time: 0.471059 Jul 18 02:46:33.138396 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 585/1173] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:46:32 2022] POST /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 02:46:33.147668 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-161412cd-7b8a-4be8-a52d-b0c43fa1c9ef tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:33.147668 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-161412cd-7b8a-4be8-a52d-b0c43fa1c9ef tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:33.153708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-161412cd-7b8a-4be8-a52d-b0c43fa1c9ef tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:33.154191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-161412cd-7b8a-4be8-a52d-b0c43fa1c9ef tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:33.154966 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-161412cd-7b8a-4be8-a52d-b0c43fa1c9ef tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:33.155390 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-161412cd-7b8a-4be8-a52d-b0c43fa1c9ef tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:33.303729 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-161412cd-7b8a-4be8-a52d-b0c43fa1c9ef tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:33.311084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-161412cd-7b8a-4be8-a52d-b0c43fa1c9ef tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1516 microversion: 2.1 time: 0.168554 Jul 18 02:46:33.311966 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 589/1174] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:33 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:34.329454 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-707b20a2-f2d2-45a5-a5cf-4cd220add9b9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:34.330065 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-707b20a2-f2d2-45a5-a5cf-4cd220add9b9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:34.337158 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-707b20a2-f2d2-45a5-a5cf-4cd220add9b9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:34.337666 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-707b20a2-f2d2-45a5-a5cf-4cd220add9b9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:34.338475 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-707b20a2-f2d2-45a5-a5cf-4cd220add9b9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:34.338913 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-707b20a2-f2d2-45a5-a5cf-4cd220add9b9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:34.474968 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-707b20a2-f2d2-45a5-a5cf-4cd220add9b9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:34.478413 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:34.482821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-707b20a2-f2d2-45a5-a5cf-4cd220add9b9 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1516 microversion: 2.1 time: 0.157795 Jul 18 02:46:34.483389 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 586/1175] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:34 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:35.499935 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-36cc6714-abbc-4495-b09e-73653bccbe30 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:35.500556 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-36cc6714-abbc-4495-b09e-73653bccbe30 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:35.507785 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-36cc6714-abbc-4495-b09e-73653bccbe30 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:35.508231 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-36cc6714-abbc-4495-b09e-73653bccbe30 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:35.508989 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-36cc6714-abbc-4495-b09e-73653bccbe30 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:35.509423 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-36cc6714-abbc-4495-b09e-73653bccbe30 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:35.645531 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-36cc6714-abbc-4495-b09e-73653bccbe30 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:35.653179 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-36cc6714-abbc-4495-b09e-73653bccbe30 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1518 microversion: 2.1 time: 0.157069 Jul 18 02:46:35.653730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 590/1176] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:35 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:36.671304 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-dca155ad-3e99-4704-a34c-444f7d80d894 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:36.672075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-dca155ad-3e99-4704-a34c-444f7d80d894 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:36.679100 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dca155ad-3e99-4704-a34c-444f7d80d894 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:36.679546 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dca155ad-3e99-4704-a34c-444f7d80d894 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:36.680323 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dca155ad-3e99-4704-a34c-444f7d80d894 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:36.680759 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-dca155ad-3e99-4704-a34c-444f7d80d894 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:36.883522 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-dca155ad-3e99-4704-a34c-444f7d80d894 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:36.891322 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-dca155ad-3e99-4704-a34c-444f7d80d894 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.224424 Jul 18 02:46:36.891914 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 587/1177] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:36 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:37.908646 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3aaddc53-b278-4301-9f80-53e9f497e476 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:37.909288 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3aaddc53-b278-4301-9f80-53e9f497e476 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:37.916437 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3aaddc53-b278-4301-9f80-53e9f497e476 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:37.916885 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3aaddc53-b278-4301-9f80-53e9f497e476 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:37.917652 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3aaddc53-b278-4301-9f80-53e9f497e476 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:37.918106 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3aaddc53-b278-4301-9f80-53e9f497e476 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:38.048772 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3aaddc53-b278-4301-9f80-53e9f497e476 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:38.056273 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3aaddc53-b278-4301-9f80-53e9f497e476 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.151468 Jul 18 02:46:38.056841 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 591/1178] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:37 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:39.073213 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-9797f6ba-cea5-4cc4-aff4-26025b2611f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:39.073846 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-9797f6ba-cea5-4cc4-aff4-26025b2611f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:39.079999 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9797f6ba-cea5-4cc4-aff4-26025b2611f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.080456 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9797f6ba-cea5-4cc4-aff4-26025b2611f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.081219 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9797f6ba-cea5-4cc4-aff4-26025b2611f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:39.081756 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-9797f6ba-cea5-4cc4-aff4-26025b2611f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:39.217766 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-9797f6ba-cea5-4cc4-aff4-26025b2611f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:39.225930 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-9797f6ba-cea5-4cc4-aff4-26025b2611f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.156393 Jul 18 02:46:39.227260 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 588/1179] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:39 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:40.243374 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-90db3025-2fa0-4811-9ec4-1b428c1dfa1e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:40.243988 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-90db3025-2fa0-4811-9ec4-1b428c1dfa1e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:40.250798 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-90db3025-2fa0-4811-9ec4-1b428c1dfa1e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:40.251251 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-90db3025-2fa0-4811-9ec4-1b428c1dfa1e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:40.252149 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-90db3025-2fa0-4811-9ec4-1b428c1dfa1e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:40.252704 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-90db3025-2fa0-4811-9ec4-1b428c1dfa1e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:40.386299 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-90db3025-2fa0-4811-9ec4-1b428c1dfa1e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:40.393893 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-90db3025-2fa0-4811-9ec4-1b428c1dfa1e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.155086 Jul 18 02:46:40.394488 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 592/1180] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:40 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:41.411015 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-cc9efe44-db2b-4182-8097-2fe97ffe9b21 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:41.411693 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-cc9efe44-db2b-4182-8097-2fe97ffe9b21 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:41.418164 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cc9efe44-db2b-4182-8097-2fe97ffe9b21 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:41.418615 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cc9efe44-db2b-4182-8097-2fe97ffe9b21 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:41.419395 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cc9efe44-db2b-4182-8097-2fe97ffe9b21 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:41.419883 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-cc9efe44-db2b-4182-8097-2fe97ffe9b21 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:41.555020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-cc9efe44-db2b-4182-8097-2fe97ffe9b21 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:41.563574 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-cc9efe44-db2b-4182-8097-2fe97ffe9b21 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.156420 Jul 18 02:46:41.564139 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 589/1181] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:41 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:42.581002 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-895fa0ff-212d-4f0a-a266-6c538f22e8f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:42.581807 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-895fa0ff-212d-4f0a-a266-6c538f22e8f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:42.588852 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-895fa0ff-212d-4f0a-a266-6c538f22e8f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:42.589309 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-895fa0ff-212d-4f0a-a266-6c538f22e8f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:42.590109 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-895fa0ff-212d-4f0a-a266-6c538f22e8f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:42.590608 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-895fa0ff-212d-4f0a-a266-6c538f22e8f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:42.723869 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-895fa0ff-212d-4f0a-a266-6c538f22e8f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:42.731795 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-895fa0ff-212d-4f0a-a266-6c538f22e8f5 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.154749 Jul 18 02:46:42.732378 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 593/1182] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:42 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:43.750205 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-28096c1e-82fd-4691-abcb-dd386e676e38 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:43.750813 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-28096c1e-82fd-4691-abcb-dd386e676e38 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:43.757164 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-28096c1e-82fd-4691-abcb-dd386e676e38 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:43.757610 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-28096c1e-82fd-4691-abcb-dd386e676e38 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:43.758474 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-28096c1e-82fd-4691-abcb-dd386e676e38 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:43.758909 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-28096c1e-82fd-4691-abcb-dd386e676e38 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:43.894377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-28096c1e-82fd-4691-abcb-dd386e676e38 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:43.903436 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-28096c1e-82fd-4691-abcb-dd386e676e38 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.157134 Jul 18 02:46:43.904493 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 590/1183] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:43 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:44.921548 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-03670c50-b5a0-45e4-b839-44e140cbcd60 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:44.922184 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-03670c50-b5a0-45e4-b839-44e140cbcd60 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:44.928856 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-03670c50-b5a0-45e4-b839-44e140cbcd60 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:44.929299 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-03670c50-b5a0-45e4-b839-44e140cbcd60 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:44.930762 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-03670c50-b5a0-45e4-b839-44e140cbcd60 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:44.931392 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-03670c50-b5a0-45e4-b839-44e140cbcd60 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:45.059341 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-03670c50-b5a0-45e4-b839-44e140cbcd60 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:45.067136 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-03670c50-b5a0-45e4-b839-44e140cbcd60 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.149460 Jul 18 02:46:45.067710 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 594/1184] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:44 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:46.084118 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-021562d9-e42e-45e6-805e-550d708f91c3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:46.084745 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-021562d9-e42e-45e6-805e-550d708f91c3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:46.091281 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-021562d9-e42e-45e6-805e-550d708f91c3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:46.091728 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-021562d9-e42e-45e6-805e-550d708f91c3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:46.092478 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-021562d9-e42e-45e6-805e-550d708f91c3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:46.092909 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-021562d9-e42e-45e6-805e-550d708f91c3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:46.221850 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-021562d9-e42e-45e6-805e-550d708f91c3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:46.230006 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-021562d9-e42e-45e6-805e-550d708f91c3 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.149770 Jul 18 02:46:46.230590 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 591/1185] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:46 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:47.246512 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-da897bcf-6ea2-4137-86bc-e3d506cf60fd tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:47.247104 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-da897bcf-6ea2-4137-86bc-e3d506cf60fd tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:47.253573 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da897bcf-6ea2-4137-86bc-e3d506cf60fd tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:47.254019 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da897bcf-6ea2-4137-86bc-e3d506cf60fd tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:47.254808 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da897bcf-6ea2-4137-86bc-e3d506cf60fd tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:47.255263 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-da897bcf-6ea2-4137-86bc-e3d506cf60fd tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:47.394391 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-da897bcf-6ea2-4137-86bc-e3d506cf60fd tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:47.404897 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-da897bcf-6ea2-4137-86bc-e3d506cf60fd tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.162139 Jul 18 02:46:47.414278 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 595/1186] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:47 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:48.421901 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-4e45bc26-bf5d-48c1-89bb-43ede974a6d4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:48.422619 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-4e45bc26-bf5d-48c1-89bb-43ede974a6d4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:48.428982 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4e45bc26-bf5d-48c1-89bb-43ede974a6d4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:48.429445 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4e45bc26-bf5d-48c1-89bb-43ede974a6d4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:48.430853 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4e45bc26-bf5d-48c1-89bb-43ede974a6d4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:48.431288 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-4e45bc26-bf5d-48c1-89bb-43ede974a6d4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:48.561851 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-4e45bc26-bf5d-48c1-89bb-43ede974a6d4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:48.569635 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-4e45bc26-bf5d-48c1-89bb-43ede974a6d4 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.151614 Jul 18 02:46:48.570226 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 592/1187] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:48 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:48.754341 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [req-d7d549c2-9136-4783-a90e-24234766d877 req-71a700fe-b40e-44c6-aae1-3580dbc04b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39", "name": "network-vif-plugged", "status": "completed", "tag": "5fd8b9bf-0dc7-4030-8d82-774afb4914af"}]} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:48.762852 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-d7d549c2-9136-4783-a90e-24234766d877 req-71a700fe-b40e-44c6-aae1-3580dbc04b5c service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:48.763303 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [req-d7d549c2-9136-4783-a90e-24234766d877 req-71a700fe-b40e-44c6-aae1-3580dbc04b5c service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:48.774644 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.compute.server_external_events [req-d7d549c2-9136-4783-a90e-24234766d877 req-71a700fe-b40e-44c6-aae1-3580dbc04b5c service nova] Creating event network-vif-plugged:5fd8b9bf-0dc7-4030-8d82-774afb4914af for instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 on hv-cinder-85001 Jul 18 02:46:48.780376 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [req-d7d549c2-9136-4783-a90e-24234766d877 req-71a700fe-b40e-44c6-aae1-3580dbc04b5c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029713 Jul 18 02:46:48.783633 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 596/1188] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:49.586564 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-3ee4d3d3-5598-4da8-bb5c-5490f4544011 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:49.587223 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-3ee4d3d3-5598-4da8-bb5c-5490f4544011 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:49.593785 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ee4d3d3-5598-4da8-bb5c-5490f4544011 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:49.594270 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ee4d3d3-5598-4da8-bb5c-5490f4544011 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:49.595024 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ee4d3d3-5598-4da8-bb5c-5490f4544011 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:49.595499 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-3ee4d3d3-5598-4da8-bb5c-5490f4544011 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:49.725165 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-3ee4d3d3-5598-4da8-bb5c-5490f4544011 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:49.734542 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-3ee4d3d3-5598-4da8-bb5c-5490f4544011 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.151744 Jul 18 02:46:49.735122 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 593/1189] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:49 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:50.480607 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-324f9baa-e515-4e6e-844a-e6c371ed9742 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1147507889"}} {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:50.481224 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-324f9baa-e515-4e6e-844a-e6c371ed9742 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:50.487540 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-324f9baa-e515-4e6e-844a-e6c371ed9742 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:50.487997 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-324f9baa-e515-4e6e-844a-e6c371ed9742 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:50.488758 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-324f9baa-e515-4e6e-844a-e6c371ed9742 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:50.489199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-324f9baa-e515-4e6e-844a-e6c371ed9742 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:50.619019 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.network.security_group_api [None req-324f9baa-e515-4e6e-844a-e6c371ed9742 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Removing security group af6413b7-1db5-4f43-a429-9ff82004545b from port 806e3d9e-a117-4a78-af51-028fc4c0d065 Jul 18 02:46:50.752207 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-8a070ff9-f155-4f5f-a5f0-f5e064e5ddbb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:50.752786 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-8a070ff9-f155-4f5f-a5f0-f5e064e5ddbb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:50.759215 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a070ff9-f155-4f5f-a5f0-f5e064e5ddbb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:50.760458 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a070ff9-f155-4f5f-a5f0-f5e064e5ddbb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:50.761236 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a070ff9-f155-4f5f-a5f0-f5e064e5ddbb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:50.761676 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-8a070ff9-f155-4f5f-a5f0-f5e064e5ddbb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:50.903479 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-8a070ff9-f155-4f5f-a5f0-f5e064e5ddbb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:50.911139 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-8a070ff9-f155-4f5f-a5f0-f5e064e5ddbb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1574 microversion: 2.1 time: 0.162876 Jul 18 02:46:50.911713 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 594/1190] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:50 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:46:51.077292 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-324f9baa-e515-4e6e-844a-e6c371ed9742 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "POST /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/action" status: 202 len: 0 microversion: 2.1 time: 0.602249 Jul 18 02:46:51.078382 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 597/1191] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 18 02:46:50 2022] POST /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:46:51.317075 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-d4501f2e-16d8-4444-9fc9-2f1396775b3b req-3ac8c4ba-8a99-4858-a258-237fa35eda81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3640269-34ee-4261-9b14-4bcfb5e666bd", "tag": "806e3d9e-a117-4a78-af51-028fc4c0d065"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:51.325835 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-d4501f2e-16d8-4444-9fc9-2f1396775b3b req-3ac8c4ba-8a99-4858-a258-237fa35eda81 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:51.326314 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-d4501f2e-16d8-4444-9fc9-2f1396775b3b req-3ac8c4ba-8a99-4858-a258-237fa35eda81 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:51.337937 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-d4501f2e-16d8-4444-9fc9-2f1396775b3b req-3ac8c4ba-8a99-4858-a258-237fa35eda81 service nova] Creating event network-changed:806e3d9e-a117-4a78-af51-028fc4c0d065 for instance b3640269-34ee-4261-9b14-4bcfb5e666bd on hv-cinder-85001 Jul 18 02:46:51.350621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-d4501f2e-16d8-4444-9fc9-2f1396775b3b req-3ac8c4ba-8a99-4858-a258-237fa35eda81 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265843 Jul 18 02:46:51.350621 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 595/1192] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:51.928792 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-c3ce1661-b360-44bc-bc49-de5c365e4ecb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:51.929681 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-c3ce1661-b360-44bc-bc49-de5c365e4ecb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:51.936712 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3ce1661-b360-44bc-bc49-de5c365e4ecb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:51.937226 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3ce1661-b360-44bc-bc49-de5c365e4ecb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:51.938050 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3ce1661-b360-44bc-bc49-de5c365e4ecb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:51.938595 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-c3ce1661-b360-44bc-bc49-de5c365e4ecb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.171937 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-c3ce1661-b360-44bc-bc49-de5c365e4ecb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:52.179526 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-c3ce1661-b360-44bc-bc49-de5c365e4ecb tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1561 microversion: 2.1 time: 0.255217 Jul 18 02:46:52.180105 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 598/1193] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:51 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1561 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:52.334295 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-564e2d7b-fcee-4ac5-b435-1298421ba8e0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:52.334965 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-564e2d7b-fcee-4ac5-b435-1298421ba8e0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:52.342807 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-564e2d7b-fcee-4ac5-b435-1298421ba8e0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.343346 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-564e2d7b-fcee-4ac5-b435-1298421ba8e0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.344160 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-564e2d7b-fcee-4ac5-b435-1298421ba8e0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.344650 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-564e2d7b-fcee-4ac5-b435-1298421ba8e0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.424834 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-564e2d7b-fcee-4ac5-b435-1298421ba8e0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lazy-loading 'services' on Instance uuid b3640269-34ee-4261-9b14-4bcfb5e666bd {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:46:52.637246 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-564e2d7b-fcee-4ac5-b435-1298421ba8e0 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments/b796c7dc-a035-4710-a3ca-4ed2d923bb34" status: 202 len: 0 microversion: 2.1 time: 0.307447 Jul 18 02:46:52.641842 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 596/1194] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:46:52 2022] DELETE /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments/b796c7dc-a035-4710-a3ca-4ed2d923bb34 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:46:52.646553 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-447c74ca-0e70-44c2-a565-65c4727b9945 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:52.647566 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-447c74ca-0e70-44c2-a565-65c4727b9945 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:52.654480 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-447c74ca-0e70-44c2-a565-65c4727b9945 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.654935 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-447c74ca-0e70-44c2-a565-65c4727b9945 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.655718 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-447c74ca-0e70-44c2-a565-65c4727b9945 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:52.656147 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-447c74ca-0e70-44c2-a565-65c4727b9945 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:52.685578 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-447c74ca-0e70-44c2-a565-65c4727b9945 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042909 Jul 18 02:46:52.686163 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 599/1195] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:46:52 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:53.372195 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-0d6b0187-c188-4820-ad08-5f0935cd6027 req-7e4b4194-eb03-4100-b727-2668982721bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3640269-34ee-4261-9b14-4bcfb5e666bd", "tag": "806e3d9e-a117-4a78-af51-028fc4c0d065"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:53.380859 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-0d6b0187-c188-4820-ad08-5f0935cd6027 req-7e4b4194-eb03-4100-b727-2668982721bb service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:53.381242 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-0d6b0187-c188-4820-ad08-5f0935cd6027 req-7e4b4194-eb03-4100-b727-2668982721bb service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:53.392483 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-0d6b0187-c188-4820-ad08-5f0935cd6027 req-7e4b4194-eb03-4100-b727-2668982721bb service nova] Creating event network-changed:806e3d9e-a117-4a78-af51-028fc4c0d065 for instance b3640269-34ee-4261-9b14-4bcfb5e666bd on hv-cinder-85001 Jul 18 02:46:53.397274 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-0d6b0187-c188-4820-ad08-5f0935cd6027 req-7e4b4194-eb03-4100-b727-2668982721bb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030470 Jul 18 02:46:53.398051 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 597/1196] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:53.697309 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-501a49bb-2f8f-43d5-b139-9fb4e3ede359 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:53.698434 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-501a49bb-2f8f-43d5-b139-9fb4e3ede359 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:53.704941 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-501a49bb-2f8f-43d5-b139-9fb4e3ede359 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:53.705388 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-501a49bb-2f8f-43d5-b139-9fb4e3ede359 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:53.706199 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-501a49bb-2f8f-43d5-b139-9fb4e3ede359 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:53.706641 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-501a49bb-2f8f-43d5-b139-9fb4e3ede359 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:53.735859 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-501a49bb-2f8f-43d5-b139-9fb4e3ede359 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042478 Jul 18 02:46:53.736876 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 600/1197] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:46:53 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:46:54.749629 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-205b8a10-e297-4895-ac72-764f6c3c2e9d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:54.750668 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-205b8a10-e297-4895-ac72-764f6c3c2e9d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:54.756792 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-205b8a10-e297-4895-ac72-764f6c3c2e9d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:54.757237 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-205b8a10-e297-4895-ac72-764f6c3c2e9d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:54.757983 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-205b8a10-e297-4895-ac72-764f6c3c2e9d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:54.758439 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-205b8a10-e297-4895-ac72-764f6c3c2e9d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:54.785923 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-205b8a10-e297-4895-ac72-764f6c3c2e9d tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041179 Jul 18 02:46:54.786501 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 598/1198] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Jul 18 02:46:54 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 02:46:54.796228 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-176c3211-9450-4f1c-8d44-6280b26af154 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:54.796775 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-176c3211-9450-4f1c-8d44-6280b26af154 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:54.802880 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-176c3211-9450-4f1c-8d44-6280b26af154 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:54.803327 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-176c3211-9450-4f1c-8d44-6280b26af154 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:54.804084 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-176c3211-9450-4f1c-8d44-6280b26af154 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:54.804519 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-176c3211-9450-4f1c-8d44-6280b26af154 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:54.879510 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-176c3211-9450-4f1c-8d44-6280b26af154 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] HTTP exception thrown: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd is not attached to volume b796c7dc-a035-4710-a3ca-4ed2d923bb34 Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-176c3211-9450-4f1c-8d44-6280b26af154 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Request method failure captured: Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: DELETE /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments/b796c7dc-a035-4710-a3ca-4ed2d923bb34 HTTP/1.1 Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MkTv1MkiwFNBpAOTFU3Am2X1RgQ-ZLD5lb1ZiKQJMQSKkg2me84cBVC1xdExRJ_kIc6myRTalL_9M5GiG8W71ZYx67S28lpofQe8iMhK1-lXUtvqgz29QOhIAHPGbQCCz4lTyUeBrgbMHQZ7nkNdDyhgupmIJTMR75POkK1FzlZd_0 Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 73679a05b6dc4583842dacfeb898876f Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-TestMinimumBasicScenario-1108786004 Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:46:54.881927 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/73679a05b6dc4583842dacfeb898876f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/73679a05b6dc4583842dacfeb898876f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/73679a05b6dc4583842dacfeb898876f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_73679a05b6dc4583842dacfeb898876f", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-TestMinimumBasicScenario-1108786004 Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 73679a05b6dc4583842dacfeb898876f Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1108786004 Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-TestMinimumBasicScenario-1108786004-project Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 3277db965cea4f23b463836d26990e1c Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-TestMinimumBasicScenario-1108786004-project Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:46:54.883773 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd is not attached to volume b796c7dc-a035-4710-a3ca-4ed2d923bb34 Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'server_id': 'b3640269-34ee-4261-9b14-4bcfb5e666bd', 'id': 'b796c7dc-a035-4710-a3ca-4ed2d923bb34'} Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b796c7dc-a035-4710-a3ca-4ed2d923bb34. Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:54.885229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd is not attached to volume b796c7dc-a035-4710-a3ca-4ed2d923bb34 Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd is not attached to volume b796c7dc-a035-4710-a3ca-4ed2d923bb34 Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:54.886819 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-176c3211-9450-4f1c-8d44-6280b26af154 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Returning 404 to user: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd is not attached to volume b796c7dc-a035-4710-a3ca-4ed2d923bb34 {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:54.887854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-176c3211-9450-4f1c-8d44-6280b26af154 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments/b796c7dc-a035-4710-a3ca-4ed2d923bb34" status: 404 len: 154 microversion: 2.1 time: 0.091128 Jul 18 02:46:54.887854 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 601/1199] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Jul 18 02:46:54 2022] DELETE /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd/os-volume_attachments/b796c7dc-a035-4710-a3ca-4ed2d923bb34 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:46:56.143749 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-1d4ae373-b0d7-45aa-83af-98b30a03f4ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:56.144233 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1d4ae373-b0d7-45aa-83af-98b30a03f4ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:56.151472 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1d4ae373-b0d7-45aa-83af-98b30a03f4ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:56.151923 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1d4ae373-b0d7-45aa-83af-98b30a03f4ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:56.152710 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1d4ae373-b0d7-45aa-83af-98b30a03f4ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:56.153148 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-1d4ae373-b0d7-45aa-83af-98b30a03f4ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:56.176770 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-1d4ae373-b0d7-45aa-83af-98b30a03f4ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Going to try to terminate instance {{(pid=124891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:46:56.438272 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-1d4ae373-b0d7-45aa-83af-98b30a03f4ab tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 204 len: 0 microversion: 2.1 time: 0.298045 Jul 18 02:46:56.438862 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 599/1200] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:46:56 2022] DELETE /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:46:56.447996 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3c3b873c-671e-4567-9a57-83ef16d31eea tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:56.449233 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3c3b873c-671e-4567-9a57-83ef16d31eea tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:56.456080 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c3b873c-671e-4567-9a57-83ef16d31eea tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:56.456521 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c3b873c-671e-4567-9a57-83ef16d31eea tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:56.457277 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c3b873c-671e-4567-9a57-83ef16d31eea tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:56.457708 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3c3b873c-671e-4567-9a57-83ef16d31eea tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:56.587894 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-3c3b873c-671e-4567-9a57-83ef16d31eea tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:56.595377 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3c3b873c-671e-4567-9a57-83ef16d31eea tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1552 microversion: 2.1 time: 0.151959 Jul 18 02:46:56.598124 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 602/1201] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:56 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:57.614437 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-24b0fdd2-55d0-41a3-899b-31df2a0b480b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:57.615161 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-24b0fdd2-55d0-41a3-899b-31df2a0b480b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:57.622020 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24b0fdd2-55d0-41a3-899b-31df2a0b480b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:57.622504 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24b0fdd2-55d0-41a3-899b-31df2a0b480b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:57.623269 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24b0fdd2-55d0-41a3-899b-31df2a0b480b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:57.623818 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-24b0fdd2-55d0-41a3-899b-31df2a0b480b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:57.751847 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-24b0fdd2-55d0-41a3-899b-31df2a0b480b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:57.759252 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-24b0fdd2-55d0-41a3-899b-31df2a0b480b tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1552 microversion: 2.1 time: 0.149154 Jul 18 02:46:57.759821 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 600/1202] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:57 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:58.776786 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-e1677d7a-af12-4335-a294-0fc8a03b06bd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:58.778025 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-e1677d7a-af12-4335-a294-0fc8a03b06bd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:58.784581 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1677d7a-af12-4335-a294-0fc8a03b06bd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:58.785033 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1677d7a-af12-4335-a294-0fc8a03b06bd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:58.785874 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1677d7a-af12-4335-a294-0fc8a03b06bd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:58.786460 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-e1677d7a-af12-4335-a294-0fc8a03b06bd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:58.854750 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-1fd88ae5-215a-49c5-8770-3ee1159aac82 req-138ec582-5dcb-42af-8452-523cdda4b831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3640269-34ee-4261-9b14-4bcfb5e666bd", "name": "network-vif-deleted", "tag": "806e3d9e-a117-4a78-af51-028fc4c0d065"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:46:58.860226 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-e1677d7a-af12-4335-a294-0fc8a03b06bd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3277db965cea4f23b463836d26990e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a05b6dc4583842dacfeb898876f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:46:58.867600 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-1fd88ae5-215a-49c5-8770-3ee1159aac82 req-138ec582-5dcb-42af-8452-523cdda4b831 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:58.868097 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-1fd88ae5-215a-49c5-8770-3ee1159aac82 req-138ec582-5dcb-42af-8452-523cdda4b831 service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:58.874038 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-e1677d7a-af12-4335-a294-0fc8a03b06bd tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 200 len: 1510 microversion: 2.1 time: 0.101029 Jul 18 02:46:58.880569 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 603/1203] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:58 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 1510 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:46:58.883144 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-1fd88ae5-215a-49c5-8770-3ee1159aac82 req-138ec582-5dcb-42af-8452-523cdda4b831 service nova] Creating event network-vif-deleted:806e3d9e-a117-4a78-af51-028fc4c0d065 for instance b3640269-34ee-4261-9b14-4bcfb5e666bd on hv-cinder-85001 Jul 18 02:46:58.888987 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-1fd88ae5-215a-49c5-8770-3ee1159aac82 req-138ec582-5dcb-42af-8452-523cdda4b831 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037869 Jul 18 02:46:58.889581 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 601/1204] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 02:46:59.891763 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3ca9b7d9-5573-48a0-970e-9adcb5c44c21 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:46:59.892398 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-3ca9b7d9-5573-48a0-970e-9adcb5c44c21 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] [instance: b3640269-34ee-4261-9b14-4bcfb5e666bd] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:46:59.898965 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ca9b7d9-5573-48a0-970e-9adcb5c44c21 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:59.899422 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ca9b7d9-5573-48a0-970e-9adcb5c44c21 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:59.900191 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ca9b7d9-5573-48a0-970e-9adcb5c44c21 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:46:59.900644 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-3ca9b7d9-5573-48a0-970e-9adcb5c44c21 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:46:59.914328 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-3ca9b7d9-5573-48a0-970e-9adcb5c44c21 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] HTTP exception thrown: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd could not be found. Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3ca9b7d9-5573-48a0-970e-9adcb5c44c21 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Request method failure captured: Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd HTTP/1.1 Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MkTv1MkiwFNBpAOTFU3Am2X1RgQ-ZLD5lb1ZiKQJMQSKkg2me84cBVC1xdExRJ_kIc6myRTalL_9M5GiG8W71ZYx67S28lpofQe8iMhK1-lXUtvqgz29QOhIAHPGbQCCz4lTyUeBrgbMHQZ7nkNdDyhgupmIJTMR75POkK1FzlZd_0 Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 73679a05b6dc4583842dacfeb898876f Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-TestMinimumBasicScenario-1108786004 Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:46:59.915870 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/73679a05b6dc4583842dacfeb898876f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/73679a05b6dc4583842dacfeb898876f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/73679a05b6dc4583842dacfeb898876f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_73679a05b6dc4583842dacfeb898876f", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-TestMinimumBasicScenario-1108786004 Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 73679a05b6dc4583842dacfeb898876f Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1108786004 Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-TestMinimumBasicScenario-1108786004-project Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 3277db965cea4f23b463836d26990e1c Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-TestMinimumBasicScenario-1108786004-project Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd could not be found. Jul 18 02:46:59.918175 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'b3640269-34ee-4261-9b14-4bcfb5e666bd'} Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd could not be found. Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:46:59.919107 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd could not be found. Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd could not be found. Jul 18 02:46:59.920617 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:46:59.922052 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-3ca9b7d9-5573-48a0-970e-9adcb5c44c21 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Returning 404 to user: Instance b3640269-34ee-4261-9b14-4bcfb5e666bd could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:46:59.922052 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-3ca9b7d9-5573-48a0-970e-9adcb5c44c21 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd" status: 404 len: 111 microversion: 2.1 time: 0.029391 Jul 18 02:46:59.922052 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 604/1205] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:46:59 2022] GET /compute/v2.1/servers/b3640269-34ee-4261-9b14-4bcfb5e666bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:46:59.927400 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-2b3d13de-0d25-4375-a96e-460952821be1 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] Calling method '.version_select at 0x7f28f2e3a040>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:47:00.021556 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-2b3d13de-0d25-4375-a96e-460952821be1 tempest-TestMinimumBasicScenario-1108786004 tempest-TestMinimumBasicScenario-1108786004-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-426497838" status: 202 len: 0 microversion: 2.1 time: 0.098308 Jul 18 02:47:00.022155 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 602/1206] 10.222.0.66 () {58 vars in 1268 bytes} [Mon Jul 18 02:46:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-426497838 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:48:06.201731 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:06.202663 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG dbcounter [-] [124891] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:06.203323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-b82c7c16-e900-4345-9fbf-ab0b1977df58 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:06.203883 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b82c7c16-e900-4345-9fbf-ab0b1977df58 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:06.207004 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-498cdbc9-36a9-4d8f-9711-a810588bd086 req-28ac65e6-b169-4da0-9979-775f7663da3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39", "tag": "5fd8b9bf-0dc7-4030-8d82-774afb4914af"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:06.208058 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_api:SELECT=37 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:06.208730 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG dbcounter [-] [124890] Writing DB stats nova_cell1:SELECT=96 {{(pid=124890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:06.213356 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b82c7c16-e900-4345-9fbf-ab0b1977df58 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:06.213823 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b82c7c16-e900-4345-9fbf-ab0b1977df58 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:06.214631 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b82c7c16-e900-4345-9fbf-ab0b1977df58 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:06.215288 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-b82c7c16-e900-4345-9fbf-ab0b1977df58 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:06.219558 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-498cdbc9-36a9-4d8f-9711-a810588bd086 req-28ac65e6-b169-4da0-9979-775f7663da3c service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:06.220008 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-498cdbc9-36a9-4d8f-9711-a810588bd086 req-28ac65e6-b169-4da0-9979-775f7663da3c service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:06.232016 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-498cdbc9-36a9-4d8f-9711-a810588bd086 req-28ac65e6-b169-4da0-9979-775f7663da3c service nova] Creating event network-changed:5fd8b9bf-0dc7-4030-8d82-774afb4914af for instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 on hv-cinder-85001 Jul 18 02:48:06.237703 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-498cdbc9-36a9-4d8f-9711-a810588bd086 req-28ac65e6-b169-4da0-9979-775f7663da3c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037777 Jul 18 02:48:06.238517 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 603/1207] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:06.241976 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-b82c7c16-e900-4345-9fbf-ab0b1977df58 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Going to try to terminate instance {{(pid=124890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 02:48:06.434050 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-b82c7c16-e900-4345-9fbf-ab0b1977df58 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 204 len: 0 microversion: 2.1 time: 0.232255 Jul 18 02:48:06.434744 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 605/1208] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Jul 18 02:48:06 2022] DELETE /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 02:48:06.445634 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-03ca1370-22cc-4b16-8374-1b33f598678e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:06.447354 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-03ca1370-22cc-4b16-8374-1b33f598678e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:06.458427 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-03ca1370-22cc-4b16-8374-1b33f598678e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:06.459369 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-03ca1370-22cc-4b16-8374-1b33f598678e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:06.460503 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-03ca1370-22cc-4b16-8374-1b33f598678e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:06.461146 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-03ca1370-22cc-4b16-8374-1b33f598678e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:06.608215 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-03ca1370-22cc-4b16-8374-1b33f598678e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:06.617009 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-03ca1370-22cc-4b16-8374-1b33f598678e tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.177137 Jul 18 02:48:06.617607 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 604/1209] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:06 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:07.635892 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-423bd853-f0ab-4da5-8274-14a477866eae tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:07.636605 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-423bd853-f0ab-4da5-8274-14a477866eae tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:07.643155 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-423bd853-f0ab-4da5-8274-14a477866eae tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:07.643596 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-423bd853-f0ab-4da5-8274-14a477866eae tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:07.644349 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-423bd853-f0ab-4da5-8274-14a477866eae tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:07.644776 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-423bd853-f0ab-4da5-8274-14a477866eae tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:07.777297 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-423bd853-f0ab-4da5-8274-14a477866eae tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:07.785066 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-423bd853-f0ab-4da5-8274-14a477866eae tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1567 microversion: 2.1 time: 0.153464 Jul 18 02:48:07.787583 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 606/1210] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:07 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:08.712751 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [req-b7861d14-cb58-495a-8563-ecf1320f5369 req-dd65a18d-c512-4ec5-88dc-0bacec9208fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39", "name": "network-vif-deleted", "tag": "5fd8b9bf-0dc7-4030-8d82-774afb4914af"}]} {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 02:48:08.720943 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-b7861d14-cb58-495a-8563-ecf1320f5369 req-dd65a18d-c512-4ec5-88dc-0bacec9208fe service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:08.721393 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [req-b7861d14-cb58-495a-8563-ecf1320f5369 req-dd65a18d-c512-4ec5-88dc-0bacec9208fe service nova] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:08.732543 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.compute.server_external_events [req-b7861d14-cb58-495a-8563-ecf1320f5369 req-dd65a18d-c512-4ec5-88dc-0bacec9208fe service nova] Creating event network-vif-deleted:5fd8b9bf-0dc7-4030-8d82-774afb4914af for instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 on hv-cinder-85001 Jul 18 02:48:08.737283 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [req-b7861d14-cb58-495a-8563-ecf1320f5369 req-dd65a18d-c512-4ec5-88dc-0bacec9208fe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028242 Jul 18 02:48:08.744240 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 605/1211] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 18 02:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 02:48:08.802342 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-6bffa322-9859-4350-9185-75841de93ec8 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:08.803000 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-6bffa322-9859-4350-9185-75841de93ec8 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:08.810294 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bffa322-9859-4350-9185-75841de93ec8 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:08.810809 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bffa322-9859-4350-9185-75841de93ec8 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:08.811577 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bffa322-9859-4350-9185-75841de93ec8 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:08.812011 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-6bffa322-9859-4350-9185-75841de93ec8 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:08.879229 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.policy [None req-6bffa322-9859-4350-9185-75841de93ec8 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124890) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:08.887584 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-6bffa322-9859-4350-9185-75841de93ec8 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1381 microversion: 2.1 time: 0.089147 Jul 18 02:48:08.888140 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 607/1212] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:08 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1381 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 02:48:09.906379 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:09.907083 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.compute.api [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124891) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:09.913377 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.913825 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.914632 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.915070 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.945606 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:09.945911 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG oslo_concurrency.lockutils [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:09.946382 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.objects.instance [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lazy-loading 'fault' on Instance uuid e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 {{(pid=124891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 02:48:09.989426 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.policy [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681d0f989d7d459e83a32066fd5ed0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe363fe43ef4fd9aec026c4cdc3e18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124891) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 02:48:09.997272 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-91160596-30da-477d-b5ac-0fd217ef6726 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 200 len: 1223 microversion: 2.1 time: 0.095750 Jul 18 02:48:09.997968 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 606/1213] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:09 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 02:48:11.014493 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a5d052ec-ff47-4d6e-8827-53c1d5e42933 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '>' {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:11.015269 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.compute.api [None req-a5d052ec-ff47-4d6e-8827-53c1d5e42933 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] [instance: e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39] Fetching instance by UUID {{(pid=124890) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 02:48:11.021985 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a5d052ec-ff47-4d6e-8827-53c1d5e42933 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:11.022534 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a5d052ec-ff47-4d6e-8827-53c1d5e42933 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:11.023316 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a5d052ec-ff47-4d6e-8827-53c1d5e42933 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 02:48:11.023757 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG oslo_concurrency.lockutils [None req-a5d052ec-ff47-4d6e-8827-53c1d5e42933 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Lock "96635aa1-f097-4770-8a14-36db95b56343" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 02:48:11.037700 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.wsgi [None req-a5d052ec-ff47-4d6e-8827-53c1d5e42933 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] HTTP exception thrown: Instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 could not be found. Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a5d052ec-ff47-4d6e-8827-53c1d5e42933 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Request method failure captured: Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: request: GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 HTTP/1.1 Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept: application/json Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Accept-Encoding: identity Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Connection: close Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Length: 0 Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Content-Type: application/json Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Host: 10.222.0.66 Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Openstack-System-Scope: None Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: User-Agent: python-urllib3/1.26.9 Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Auth-Token: gAAAAABi1MiuWheBTAC3hR_AqIsCYsQwQHdR3FbG8NgvUt2lZRrvfTZJVhxrZMLQAKrUepZ-d2pL-C3-nbQiv7kzBU_piX6euvgg3vSvQsAs1-60rLk-xUcVcVil3hjr4JzrOCndqGwUo0gc0UP16pe3H8Q0jLFJZLACKmMPUGjWB-iD-GBocTY Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Id: None Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Domain-Name: None Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Identity-Status: Confirmed Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Is-Admin-Project: True Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Id: default Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Domain-Name: Default Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Id: 2fe363fe43ef4fd9aec026c4cdc3e18e Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Project-Name: tempest-TestShelveInstance-1352231499 Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Role: member,reader Jul 18 02:48:11.039544 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Roles: member,reader Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2fe363fe43ef4fd9aec026c4cdc3e18e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2fe363fe43ef4fd9aec026c4cdc3e18e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2fe363fe43ef4fd9aec026c4cdc3e18e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2fe363fe43ef4fd9aec026c4cdc3e18e", "adminURL": "http://10.222.0.66:8080"}]}] Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant: tempest-TestShelveInstance-1352231499 Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Id: 2fe363fe43ef4fd9aec026c4cdc3e18e Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-Tenant-Name: tempest-TestShelveInstance-1352231499 Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User: tempest-TestShelveInstance-1352231499-project Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Id: default Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Domain-Name: Default Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Id: 681d0f989d7d459e83a32066fd5ed0a2 Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: X-User-Name: tempest-TestShelveInstance-1352231499-project Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: method: > Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: exception: Instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 could not be found. Jul 18 02:48:11.041904 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: action_args: {'id': 'e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39'} Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: {{(pid=124890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 could not be found. Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 02:48:11.043063 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 could not be found. Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 could not be found. Jul 18 02:48:11.044802 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: ERROR nova.api.openstack.wsgi Jul 18 02:48:11.050947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: DEBUG nova.api.openstack.wsgi [None req-a5d052ec-ff47-4d6e-8827-53c1d5e42933 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Returning 404 to user: Instance e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 could not be found. {{(pid=124890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 02:48:11.050947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO nova.api.openstack.requestlog [None req-a5d052ec-ff47-4d6e-8827-53c1d5e42933 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39" status: 404 len: 111 microversion: 2.1 time: 0.030403 Jul 18 02:48:11.050947 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: [pid: 124890|app: 0|req: 608/1214] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Jul 18 02:48:11 2022] GET /compute/v2.1/servers/e71c2b6c-ae9d-4fb5-a0de-4f3efa116b39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 02:48:11.274460 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: DEBUG nova.api.openstack.wsgi [None req-86add4f0-4f48-478e-b468-564aebd11978 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] Calling method '.version_select at 0x7f28ee8aadc0>' {{(pid=124891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 02:48:11.368335 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO nova.api.openstack.requestlog [None req-86add4f0-4f48-478e-b468-564aebd11978 tempest-TestShelveInstance-1352231499 tempest-TestShelveInstance-1352231499-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-443196027" status: 202 len: 0 microversion: 2.1 time: 0.097717 Jul 18 02:48:11.368922 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: [pid: 124891|app: 0|req: 607/1215] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Jul 18 02:48:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-443196027 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 02:48:43.044572 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:48:43.045204 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Mon Jul 18 02:48:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:50:12.233705 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:50:12.234493 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Mon Jul 18 02:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:50:16.904859 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:50:16.905436 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Mon Jul 18 02:50:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:50:30.977323 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:50:30.977836 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Mon Jul 18 02:50:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:50:46.788633 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:50:46.793519 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Mon Jul 18 02:50:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:51:56.234809 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:51:56.235579 dv-cinder-850015-3-iscsi devstack@n-api.service[124891]: Mon Jul 18 02:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:52:03.052801 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:52:03.053405 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Mon Jul 18 02:52:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 02:53:32.242074 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 02:53:32.242769 dv-cinder-850015-3-iscsi devstack@n-api.service[124890]: Mon Jul 18 02:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!